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Pause Analysis as a Short Interviewing Technique 


Walter Toman 


Harvard University 


The basic rule for the patient in psychoan- 
alytic treatment is to say everything that comes 
to his mind, without selection [1, p. 23; 2, p- 
192]. He is to associate freely, and whenever 
he stops, whenever he makes a pause, the psy- 
choanalyst is, in principle, permitted to prod 
the patient. Thus the pauses the patient makes 
become specific points of interaction, and it 
seems quite possible that some of the peculiar- 
ity of psychoanalytic treatment when compared 
to any other form of psychotherapy springs 
from this procedure. 


In prodding the patient to express what 
went on in his mind during the pause, or what 
idea interfered and made him stop, the analyst 
risks diverting the patient from the ongoing 
trend of free association, and at times it might 
be more important, therapeutically, to prod the 
patient to go on. At times the interruption by 
the analyst may be quite welcome to the 
patient, and the welcome topics are not al- 
ways the ones psychoanalysis is after. In addi- 
tion we should realize that it is when the 
patient pauses, that interpretations by the 
analyst or even questions leading up to inter- 
pretations are made. Seldom is such a question 
raised or an interpretation started by the ther- 
apist while the patient is still talking. Thus 
with a question referring to anything but the 
pause, we miss the pause, and with any ques- 
tion referring to the pause, we might miss 
further associations. It takes considerable skill 
to handle these intricate “molecular” inter- 
actions occurring in psychoanalysis, and this 
skill, in turn, requires training and experience, 
and experience and training, ad infinitum. 

In 1950 H. Rohracher of the University of 
Vienna suggested an explanation of pauses in 
speech. While Johanna Karger started work- 
ing on the quantitative and classificatory analy- 
sis of pauses in reading and speaking Bl I 
began to labor on the dynamic aspects. The 


reasoning given above was the starting point. 
Before I describe my proceedings, I would like 
to give a brief account of Karger’s findings. 


Twelve subjects had to read a short text aloud. 
They were sound-recorded and the pauses were ex- 
plained afterwards by the subjects. Ninety-three per 
cent of the pauses were connected with punctuation 
marks, the rest with disturbances of task-aware- 
ness, distraction of attention, difficulties in apper- 
ception and conflicts between punctuation marks 
and personal organization of the text. The longest 
pauses varied between 0.5 and 1 second, and never 
exceeded 1.8 seconds. In free speech as contrasted 
with reading (instruction: “Explain why you chose 
your field of study or your particular profession.”) 
the longest pauses exceeded 1.8 seconds with every 
subject. It was found that the faster the subject 
speaks, the greater the relative and the absolute 
average length of his or her pauses. The ratio of 
pauses made at all and pauses which the subjects 
recognized as pauses and explained was 6:1. The 
estimate of number of pauses made at all was based 
on the minimal time interval between two spoken 
words that a keen observer would just begin to 
consider a pause. This estimate depended on the 
rigor of the observer, and my ratio of 54.7:17 re- 
ported below does not contradict the former ratio. 
It only indicates a different standard as to what 
might possibly be considered a pause, and this 
standard is not crucial for my experiment. The 
causes of pauses in free speech were: (a) disturb- 
ances of composition, (b) distractions of attention, 
(c) disturbances in production of ideas, (d) pauses 
due to ordering the material, (e) time-consuming 
will processes, (f) disturbances in verbal expres- 
sion (breathing, fatigue, slips of the tongue, etc.), 
—_ further specifications were attempted by J. Kar- 


The Experiment 


My experiment called for a life history of 
5 to 10 minutes length, to be spoken by the 
subject into the microphone of a sound recorsj- 
er. The subjects were given a casual half- 
minute of preparation, during which the ex- 
perimenter got the sound recorder read 4 
pretended to do so. Then the subjects a 
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their life history into the microphone. They 
were asked to take about 5 to 10 minutes, and 
to make it not too factual. The experimenter 
was present but did not interfere, not even by 
nodding or by any changes in facial expression. 


After the life history was completed, the ex- 
perimenter and the subject went over the 
record and analyzed the pauses. Only then did 
the subjects learn that the pauses were the 
object of investigation. About three-fourths of 
the subjects were surprised by the fact that 
apparently so much had gone on “between the 
lines” of their performance that otherwise 
would have escaped their notice. 


Results 


All of 35 subjects ranging from 18 to 34 
years (13 male and 8 female students, 6 male 
and 3 female adults in nonacademic profess- 
ions, and 3 male and 2 female adults in aca- 
demic professions) revealed content material 
hidden or suppressed in the pauses that proba- 
bly could not have been brought to light by 
other interviewing procedures in the given 
time, i. e., 5 to 10 minutes talking and 10 to 
30 minutes of analyzing the pauses of the 
monologue. Subsequent to the test an interview 
was conducted with every subject in order to 
enable the experimenter to further appraise 
the significance of the content filled into the 
pauses by the subject while going over the 
record with the experimenter. A few examples 
of the performance will be given below. 


The subjects produced life histories of an 
average length of 675 words, with a standard 
deviation of 230 words. They made an 
average of 54.4 pauses (with a standard devi- 
ation of 26), of which 17 pauses on the 
average (with a standard deviation of 9.2) 
ould be interpreted by the subjects other than 
by mere formal difficulties of phrasing or 
searching for appropriate words. 


In order to obtain some sort of an objective 
measure for the significance of the content 
material given by the subjects when inter- 
preting their pauses, they were unexpectedly 
asked to come for another session 1 to 3 
months later. Then they were exposed to their 
records again and asked to interpret the pauses 
again as far as they could still remember them. 
On the average 5.3 pauses were recalled (with 


a standard deviation of 2.7). The content of 
the other pauses had been forgotten. It turned 
out that 2.8 of the recalled pauses, i.e., of the 
recalled ideas or images or thoughts that had 
originally interfered with the deliv ry of their 
life history, were apparently affect-laden early 
memories, even very carly childhood mema- 
ries, that had oddly popped into the subjects’ 
minds while speaking into the microphone. 
The rest were recent memories concerning the 
subjects’ present activities and occupations, 
recent personal relationships and thoughts per- 
taining to the performance of the test. 


These latter memories were presumably not 
too difficult to recall nor even to reconstruct 
from the context; but the earlier memories 
that would appear out of context of the de- 
livered life history to anyone but the subject 
himself or a sophisticated psychologist would 
have been impossible to recall unless the same 
dynamic factor that had originally brought 
them up had been reactivated, These memories 
seem to stand for stronger (older and possibly 
unconscious) dynamic constellations. We may 
conclude that they were significant, important 
memories, otherwise the subject would not 
have recalled them on the right spot in the 
objectively inconspicuous context of his de- 
livered life history. In that sense this check 
may be considered an objective measure for 
the significance of the content material given 
by the subjects when interpreting their pauses. 


: Four examples of records interpreted 
immediately after the test are given below. 
All further references and comments to the 
cases have been omitted, They will serve only 
as a demonstration of the test performance in- 
cluding the interpreted pauses, Thoughts 
going on during the pauses and reported by 
the subjects while going over the sound record 
with the experimenter are underlined. 


Examples 
Subject A (male, 20 years old) 


I remember very little of the first few years. 
Just that I was born in K. and moved immediately 
to D. where I lived until I was about 5 years old. 
I had a very... a little scene in kindergarden. A 
little girl awas crying lustily when having to stay 
there. I cried too. We made quite a scene... 
strong, childish attraction for a little blonde girl 
there, and we have kept writing ever since, and 
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she came to K last, last month, which was the 
first date I have had for, during my college ex- 
perience. This particularly bothers me. Anyway, 
then we moved to E. I went to the local grammar 
school, very... out in the country, worst teachers, 
poor reputation. Father worked to set up schools. 
Had many enemies, Mother has practically gone 
blind (over all this). She is very introverted and 
sensitive . . . poor grammar school, actually, and 
there I had three good boy friends, and one pretty 
plonde girl again with whom I spent a number... 
her older brother got between us. Had a tent. 
Wanted his sister and me to undress and play with 
cach other. I never liked the fellow .. . of the first 
few years. I can remember that I used to be ter- 
rifically sensitive in grammar school, particularly 
about playing sports. I was very slow on my feet. 
I could not run in the right way. I used to run on 
my toes instead of on my feet. So the others would 
goad me into playing tag with them, practically 
every day during the first 6 years of grammar 
school, it seems, anyway. And I would get... I 
got very hurt and nervous. My best friends were 
wery callous. Were best friends, and stabbed you 
in the next minute. I was worried about other 
people’s opinion about me... . I tried not to show 
my anger and, but it did affect me very much. I 
was very easily offended and hurt. I remember one 
time that one boy who was actually my best friend 
made a nasty remark, and I had to stay home that 
afternoon, because I could not... - I lowered my- 
self by offering him a bicycle ride home. Felt dis- 
gusted with myself . . . face going back to school 
again. Then going to high school I did very well 
in school. I was number one student in town grad- 
uating to high school and so I had a very easy 
time. My brother went to high school the year be- 
fore, and he made such a terrifically good impres- 
sion that I got by on his own scholastic ability, that 
is, they gave me all A’s without really knowing. 
... I felt inferior to my brother. But then I became 
the first in town. My brother had left town... 
what my own talents were. Although I don’t know 
whether I would have gotten A’s or not. Probably 
yes. But I never had a date with a girl during 
high school and this particularly bothered me. I 
never learned to dance, and I felt that was one of 
the most unfortunate parts of it... . My parents 
should have encouraged me. They let me down. 
Brought me up in the wrong way. Later on I 
talked it over with my father. He said: “We never 
stopped you.” But I had the impression, they did 
not approve. My parents during this time 
never encouraged me or inhibited me from going 
with girls, but I never had the courage to do it 
myself, and it has carried over until now, practi- 
cally. I suppose this is the most interesting part of 
what I am supposed to say. I don’t know. And 
then I wanted to get on the football team in high 
school, but never did actually try out for it. Per- 
haps I could have made it. Then during my jun- 


ior year of high school my parents decided they 
wanted me to go to A. for my senior year, and so 
I had to work very, very hard then in order to 
make the scholastic standing necessary to get into 
A. I did get into A. with full scholarship and felt 
pretty good about my own capabilites then. But 
when I got there I found that in the first term in A. 
I got a C minus-and-a-half average, which was 
very, very poor, particularly for a scholarship boy, 
so after that I became a reclu nd spent about all 
of my time studying . . . there sere dances in A, 
Saturday nights. I svanted to go, but did not. 
Used to sit in my room... so that I had no social 
life to speak of at A, I never joined a club or any- 
thing. I just stayed in my room and ground away. 
Then 1... .My brother was in college. I was just 
going to follow him. I was not very ambitious to go. 
I just as soon would have worked... did not give 
much thought to college. I did not really expect I 
would be able to go to college, because of financial 
reasons, but I half-heartedly applied, took the col- 
lege entrance exams, and U. admitted me. It was 
the only college I had applied to. And . . . they 
should have (awarded me a scholarship). I had 
good records, eventually, A. did not elect me for 
the cum laude society. They slighted me. They sent 
me to Washington, free, for a week, though. My 
brother had been elected. . . they did not award me 
a scholarship, though. The only way I came here 
was that A. managed, A. did give me a prize 
scholarship, $400, and also the X.Y. Association 
gave me a scholarship. And also a very old lady 
who just died gave me a gift of $2500 for my 
school, my college career, which I could not have 
done without, and I did finally get to U. . . 
money stretched over 4 years made things easier, 
but still pretty hard. ... And during my freshman 
year in U. I roomed with a Jewish boy who was 
about as introverted as I was, and I found myself 
not particularly liking him, but pitying him ina 
way. . in French class two girls were sitting 
next to us, but we never approached them 
and we became rather good friends. It was a rath. 
er artificial friendship, since I . this amounts 
to saying, I am superior. His father (who had in- 
vented something and discussed advertising it with 
his son) said: “We put a nice nude on it? The 
Mie ae. ogee a a e 
rather superior elne Thad 4 i a as 8 
theless we did become v Spik pia niri Never- 
both wanted to go out “th pe! ferenda, We 
aa eT oe. V. girls, but we never 
psi so manag o rationalize myself into 
thinking that it was because of my 
, 
ie partly true, I suppose . it was in me 
rse . . . but the result w ip 
dither i as what I figured a 
poor sexual adjustment. A d hej A 
now this h i nd being a senior 
as carried over. And I have h 
date in my life ti ve had one 
Pank y ae | Fe to speak, that is a couple 
i... my an 
was older Pet I shod Pareri SURRE along. She 
uring the summer 
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times, picnics and that sort of things, but I find it 
very, very difficult to approach girls in a... . J 
am getting all worked up. This problem is a con- 
temporary one ... in a way that’s not self-con- 
scious. 


Subject B (female, 19 years old) 


I was born in N., and I can’t remember anything 
until I was about 3 years old... memory of the 
house we used to live in: picture of my uncle stand- 
ing in the toilet; father said: “He is taking a pic- 
ture. Come on!” .. . and I can remember being a 
happy child. I think I got a lot of attention... . J 
was over-protected, I guess .. . from my parents 
when I was very young. And I had a lot of suc- 
cess in school, and even in kindergarden I remem- 
ber I was the best reader... from when on was I 
a lucky child? What facts do I have? ... and I 
could draw and paint . . . this is not enough. What 
did I do at home? Can’t find anything ... and all 
that sort of thing. And I went to elementary school. 
In about the third grade, I suppose, I Was, oh, 9 
years old, I had a little trouble with the children 
in my class. I was much more withdrawn. I was 
more imaginative, introverted than they were. I 
would not really understand the more social gang- 
like times that they had... . J felt left out. I used 
to cry. Mother was so helpful. She handled me so 
good... and I felt left out. I felt very unhappy. 
I remember they used to make fun of me. And I 
was always the kind of kid that used to go by 
herself and, oh . . . fairies, later on love, also na- 
ture, lose myself in those things. Reading and writ- 
ing poems. Thoughts like: How do you feel the 
infinite? What happens if you fall forever? . mh a 
imagine things a lot. Oh, I wrote poetry starting 
from when I was 6 years old, I think. And I went 
to... much earlier than high school I became a 
social being. I left out girls, got along very well 
with boys, was never in a gang. 
lipstick, they were teen-agy 
very fine high school in N, 
academic success, 
drawnness of min 


aaa. 


relationships with teachers 
as my home life 


tritth.... 


it. Ther, was hell in the house .. . oh, they ex- 
pected a lot in the nominal achievement 
and following what their goale were, I think, much 
too much. And starting at 16 I began to rebel. I 
became critical of American culture. I think, yes, 
and this was also the same time when I thought I 
was discovering that I was popular and that I had 
a nice personality, and that the boys liked me, and 
that sort of thing. And. .. nowadays I dislike my 
adolescence. So much dishonesty in that age, effort 
to make impression, feminine aviles. Disgusting ... 
this went to my head for a little while, and after 
that I became, as I said, critical and went to the 
other extreme. I joined a, aaa... how should I 
characterize it, express the spirit? .. . youth Zion- 
ist group which was very, very, very revolutionary 
in its mores and, oh, no lipstick and girls treated 
completely equal with men... . These were the 
goals, but they did not really achieve them, Girls 
became masculine. No positive culture of their own 
- +. Ooh, really a little community within itself, and 
Marxist orientation . . . they were not even good 
Marxists . . . and tried very hard to establish hon- 
esty and introspection, and complete naturalness 
+++ some of the girls opposed integration, thought 
Zionism is the Solution, quite doctrinaire . . . I 
Suess, as goals. And oh, when I came to C. as a 
freshman, I was just, just coming out of this. ... 
Girls in C. less accepting than in N., pressure to- 
ward conformity; it was hard to accept them as 
people. I had a real war for a year.. .. I was 
always somewhat critical, and yet I found things 
there I felt, and still feel, ... competition, selfish- 
ness, sterility of the whole culture . | | are lacking 
in American culture. And I became very interested 
in Judaism as a way of life, and. politically a Zion- 
ist, and, well... . Oh, I am up to the present... 
at this point I no longer am a political Zionist. 
I am very interested in Judaism. I am interested in 
modern dancing. I do more of that, practically, 
than anything else. I have made a conscious effort 
to narrow down my . . , talents? That’s conceited 
++ + fields of expression and chosen dancing as the 
one I more or less concentrate on. I hope after col- 
lege. . , well, I don’t really know, It’s all vague 


Ò + Somehow, oh yes, I have always been interested 
1n. <.. I left out m 


really have abilities 
helping people, i 


way of 


ren, and I would like to 
dancing. And Possibl 
guess that’s about all 


Subject C (male, 27 years old) 


+ + + Shall I tell him my mother was psychotic, 
or not? asin Well, I think, one of the things that’s 
important in my life history is the... , 7 am going 
to tell him that, but I start Somewhere else... is 
the, oh, type of place of my childhood, I grew up 


- ment of .. 


Pause Analysislas a Short Interviewing Technique 


in a very small town in the West, in a culture quite 
different from the one that I am in now... . I 
felt better in childhood than nozw. Is that neurotic? 

. aaa, life there is quite in contrast to the one 
life one leads around here. It’s a rather quiet, free 
and easy sort of existence, whereas everything 
here seems to me to be very hostile, full of pres- 
sure, aaa. . What shall I say next? .. . to ac- 
complish things all the time. I find considerable 
lack of time to sit back and relax and sort of give 
jn. ... Z better not get emotional ... to the enjoy- 
. existence? living? that’s a poor sen- 
tence . . . my existence. Aaa, another very im- 
portant thing in my life are my parents, aaa... . 
Whom shall I take first? .... My father was a 
very quiet... image of him... retiring sort of 
person, very, very conscientious, working extremely 
hard, and not very ... (some thought that sub- 
ject could not recall) .. . had not very much to 
say when he was at home. Seems to me, he was a 
sort of a shadowy background figure in the house- 
hold rather... but he was warm, even though ret- 
icent . .. than a dominant person. My mother . . . 
her father very stern, militaristic, had a lot of con- 
trol, her affective needs starved ... grew up on a 
farm in the West, had, I think, a rather hard 
childhood herself that carried over to her later life, 
and... unfortunately, although I should not say 
so... to my life. I think, she tried. . . . I better 
try to understand . . . overly hard to compensate 
for some of the things that she missed in her child- 
hood, and as the result of that she tried too hard to 
make things easy for myself and for my brother 
.. . image of myself as a child of 6 or 8 . . . tried 
too hard to... control .. . protect us from the 
vicissitudes of life, rather had a certain, had a 
negative effect on my life. I think I lack a lot of 
... image of a very energetic, goal-directed per- 
son (male) ... drive and autonomy that I might 
otherwise have had... some sort of therapy might 
help, I hope . . . aaa. I think, probably the most 
significant thing in my life that I can think about, 
if I were to point to a single incidence, was the 
psychotic break that my mother had when she was 
about etc. 


Subject D (female, 21 years old) 


The first thing I remember is wanting to go to 
school and starting a little early, and liking it 
very much . . picture of myself, over-confident, 
boastful . . . and all during grammar school I was 
pretty sure of myself and liked it. And when the 
first . . . my father did not want me to go to school. 
My sister went. It was too hard. I was not strong 
enough, they said... conflict came, when it be- 
came time to choose a high school; I chose one that 
was strictly college preparatory, to which girls from 
all over R. went, as opposed to a local high school. 
And as soon as I started that I lost confidence . . , 
picture of myself. What would it be to others, 
when I make new friends? . . . felt more pressure 
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upon me. I had to work harder, was not sure of 
myself as far as making friends went, and although 
I liked school very much, I disliked the .eachers, 
the pressure I felt from them... . (After 10 sec- 
onds) I hate not to be able to say anything (fur- 
ther 20 seconds elapse)... . It was an all girls’ 
school which was nice from the point of view of 
having girl friends, though we were always quite 
shy about meeting with boys and did not like to 
go for that reason. And the school put a lot of 
pressure on it, towards choosing a good college, 
towards making us want to go, but never gave us 
a chance to decide whether or not we wanted to go. 
It just assumed that we would. And upon going to 
college I have never again felt as much pressure 
as I did in high school and was glad to go to a col- 
lege that is at least partially coed. I also felt that 
the situation was a lot more natural. 


Discussion 


There seem to be certain advantages to this 
technique. One of them is the following: The 
subjects tend to organize their thoughts as well 
as possible and to give a somewhat coherent 
story. The fact that their performance is 
sound-recorded increases their concern with 
the quality of their performance. On the other 
hand, they are not given sufficient time to or- 
ganize their story in advance. Rather they are 
caught by the sound recorder in the process of 
organizing, and in this sense the technique may 
be called a situational test. All criteria de- 
veloped for appraising verbal creations are 
eligible and may be applied. 

The effort of organizing the story for the 
sound recorder is presumably greater than the 
effort of organizing it for a listener in a more 
familiar situation like interviewing, or coun- 
seling, or any conversation. A little speculation 
may be inserted here, that has been confirmed 
on other grounds by the author. If we assume 
that a higher effort put into the performance 
would consume more “psychic energy,” 
would expect less energy to be available bow 
a concurrent activities. The main concurrent 

ivity in the delivery of one’s life hist 
consists of the defenses against makin lips, 
against revealing too much or ioven i, ; a 
emotions more than intended. We wo iho : 
dict that the greater effort may sen a 
the effectiveness of the defenses ji pa 
wanted impulses or, if this is not 2. “a 
defense mechanisms themselves hp tne 
— apparent. Both types of a 
the counselor or therapist cues about the ub 
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ject that he might not be able to secure other- 
wise, at least not in the given time or not 
simultaneously with a life history of the sub- 
ject. Examples of the first type have been given 
(subjects A, B, C). Examples of the second 
type are a few meagre life histories among my 
records, with long pauses and frequent blanks 
with respect to the pauses (subject D). These 
subjects reported that realizing that they 
made pauses extended one or the other pause 
to an unusual length, and this in turn blocked 
their performance, and caused further pauses, 
until they eventually gave up. 

Another advantage becomes clear when we 
compare this technique with psychoanalytic 
therapy in particular, but also with any coun- 
seling or interviewing technique. As pointed 
out in the beginning, the pauses are crucial 
events in psychoanalytic treatment, and how- 
ever the therapist deals with a single pause, 
he is interfering. The reported technique yields 
a record of the uninterrupted cognitive pro- 
cesses of 5 to 10 minutes in length, a sufficient 
time for a fruitful systematic analysis of the 
meaning of the pauses. 

A third advantage becomes apparent when 
the record is reviewed. The subjects are 
surprised by what they said, even surprised by 
their voice, if they have not heard it recorded 
before, and this surprise contributes strongly 
to their willingness to cooperate in the analysis 
of their pauses. They feel encouraged to take 
a more objective attitude toward what they 
said into the microphone than they do when 
reference is made to what they said in an 
ordinary interview or conversation with no 
recording. All subjects except the few who had 
given very meagre life histories with extreme- 
ly long pauses were willing to talk very frank- 
ly and openly about themselves and their lives, 
but even the defensive subjects were willing 
to talk at least about their inhibitions and 
defenses and found some relief in so doing. 
Subject and experimenter (client and thera- 
pist) are both dealing with the record of the 
subject’s past performance, and this may 
account for the objective attitude the subject 
is able to assume quite easily. According to an 
accepted psychoanalytic metaphor one part of 
the ego hes to cooperate with the analyst in 
gett:ng a hold on the unconscious parts of the 


ego (and on the other systems). The pause- 
analysis technique facilitates this cooperation. 
The subjects slide into a good contact and 
rapport with the counselor or therapist, while 
talking about their performance, their pauses, 
and even their defenses. 

A fourth advantage is the possibility of 
going over the subject’s performance at any 
later time. What pauses are recalled that have 
been interpreted (given content and meaning) 
by the subject in the first session may give 
additional cues (see “Results” above). Fur- 
thermore, the attitude of the subject to his 
now quite remote performance can be appraised 
and utilized in several clinical aspects. 

Do the subjects manage to interpret all the 
pauses they make? I would say, they manage 
to interpret all the pauses that are important 
as to contents and dynamics. Of 54.4 pauses 
on the average counted by the experimenter, 
17 pauses on the average were commented on 
and interpreted by the subjects. All the other 
pauses could safely be considered as pauses due 
to formal difficulties, difficulties of finding the 
appropriate words or of finishing a sentence. 
The subjects were asked to tell what went on 
during the pauses while hearing their records, 
and in the beginning the experimenter stopped 
the record at whatever he considered a pause, 
but soon the subjects began to cooperate quite 
efficiently by telling when to stop the record 
and when not to stop it. Among other reasons, 
this could be relied on since the subjects had 
been told that they could refuse to talk about 
things they did not want to confide. In this 
case they had only to indicate that there were 
such things. However, very few subjects re- 
sorted to that privilege. 

Can we believe what the subject reports? 
This question may be raised just as well with 
any psychological approach to personality, and 
Particularly with any form of interviewing. 
On the grounds mentioned above (good 
Tapport with experimenter, increased objective 
interest, etc.) we may expect more reliable 
Teports from the subject with the pause-analy- 
sis technique than with other short interview- 
ing techniques. 

y apply the analysis of pauses to life 
histories and not, say, to TAT stories? There 
is no reason why one should not also apply 
it successfully to TAT stories. But the life 
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history of a subject is probably the most 
crucial and important of all the stories he can 
tell. Any therapeutic effect can, in some sense, 
be viewed as a recentering, a revision of the 
life history of the subject, and it is not the 
events that are revised, but their evaluation. 
The disappearance of neurotic symptoms is 
only a secondary effect. Life histories, verbal 
or written, given by the patients before and 
after treatment may in general be the most 
valuable and easy-to-obtain, although certainly 
imperfect objective checks on these revised 
evaluations, on a changed self concept, on a 
liberated and strengthened ego, or on what- 
ever else a therapeutic success may be said to 
be based. We may also maintain that life his- 
tories can be produced repeatedly with inter- 
ferences by previous performances of no great- 
er intricacy than we would find with other 
complex clinical tests. 


All the shortcomings of this method, such 
as reliance on what the subject himself tells 
about the pauses, too many variables, too little 
quantification, no complete elimination of 
social interaction and of its interference with 
the performance to uncontrolled degrees, etc. 
hold, in one way or another, for any clinical 
test. In the pause-analysis technique the em- 
phasis is on contents and dynamics and their 
clinical appraisal. Tendenciės pertaining to 
the person’s (subject’s, patient’s) specific struc- 
ture and organization of the mind, but also 


to his performance and to the test situation 
can be traced via contents of the pauses and 
its placement in the context of the delivered 
life history, and any information that could 
not have been secured by other techniques in 
the same length of time will be valuable in 
clinical practice. The technique seems particu- 
larly promising in cases on which relatively 
little time can be spent. 


Summary 


A clinical technique has been described in 
which the subject is asked to tell his life 
history into the microphone for 5 to 10 
minutes. After that the subject and the experi- 
menter (counselor, therapist) go over the 
record and analyze the pauses the subject made. 
Some quantitative results of 35 subjects have 
been mentioned and four examples given. 
Theoretical implications, advantages and dis- 
advantages of this technique have been dis- 
cussed. 
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One important problem facing mental hy- 
giene clinics is attempting to evaluate before 
beginning therapy whether or not the patients 
have the capacity to profit from psychotherapy. 
Much time and energy ordinarily devoted to 
the unsuccessful treatment of cases might be 
more profitably diverted to the better therapy 
risks should it be possible to make such an 
evaluation correctly. Our problem, therefore, 
was to investigate the possibility of using the 
Rorschach test for prognostic purposes. In 
short, can the Rorschach test be used to pre- 
dict which cases will be successful in therapy 
in a mental hygiene clinic? 


Method 


The method used involved establishing cri- 
terion groups: one group composed of patients 
who were successful in psychotherapy; the 
other group composed of patients who were 
unsuccessful in psychotherapy. The first step 
was to proceed deductively to differentiate be- 
tween Rorschach protocols of patients in the 
criterion groups. The next step was to pro- 
ceed inductively to discover whatever differ- 
ences might exist between the criteri 


and then test these differences o 
sample, 
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Our deductive procedures included first, a 
“total impression” judgment. That is, psy- 
chologists read the patient’s Rorschach proto- 
col and predicted whether the patient was a 
member of the successful or unsuccessful 
group. Secondly, “signs” defived by Harris 
and Christianson [2] were utilized to assign 
the Rorschach protocol to either criterion 
group. Thirdly, predictions toward the cri- 
terion were made on the basis of whether the 
M present in the protocol was of the flexor or 
extensor type. Fourthly, two different com- 
binations of Rorschach variables thought like- 
ly to discriminate between the criterion groups 
were tried. The above four procedures, then, 
were a priori. 

Our inductive procedures followed the 
usual pattern of ascertaining differences be- 
tween “known groups.” First, various Ror- 
schach scores or variables were compared in 
the two groups. This comparison was made 
in terms of the percentage of persons in the 
criterion groups having a given score on a 
given variable. Secondly, patterns were devel- 
oped from an analysis of variables which 
seemed promising as discriminators and these 
patterns were applied to a new sample. The 
above two procedures, then, were a posteriori, 


Procedures and Results 


The procedure began with the establish- 
ment of the two criterion groups. One group 
consisted of 50 protocols of patients whose 
case file showed that at termination they were 
thought “unimproved.” The other group con- 
sisted of 59 protocols of patients terminated 
“slightly improved” or “improved.” The pro- 
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tocols were rescored according to Klopfer’s 
method — using, however, Beck’s tables of 
F+ and popular responses. All cases were 
selected at random from the clinic files, with- 
out regard to diagnosis or therapist. All sub- 
jects in the criterion groups, as well as in the 
cross-validation groups, were veterans who 
had had treatment at a Veterans Administra- 
tion Mental Hygiene Clinic. 


The judgments concerning the success of 
the patients in psychotherapy were made by 
the patients’ therapist in consultation with a 
senior psychiatrist. The senior psychiatrist was 
one who had been regularly consulted on the 
case. There were eight social workers, eight 
psychiatrists, and three psychologists involved. 


Deductive Procedures. 


The deductive procedures were as follows: 

Total impression judgments. Three psy- 
chologists, with Rorschach experience ranging 
from three to five years, judged each Ror- 
schach protocol for success or nonsuccess under 
four different conditions — each condition 
separated by at least a one-month interval. 


The procedure under Condition I was to 
make a snap judgment, in not more than two 
or three minutes, concerning success. The pro- 
cedure under Condition II was to make a 
studied judgment, with as much time allowed 
as was felt necessary by the psychologist 
making the judgment. Condition III was the 
same as Condition II except that the name of 
the patient’s therapist was given to the judge 
as additional data. Condition IV provided a 
check for Condition III in that the therapist’s 
name was given to the judge without the 
Rorschach protocol. That is, predictions of 
success were made from the therapist’s name 
alone. 


Validity coefficients were calculated for 
each psychologist under each condition and 
were expressed in terms of chi square com- 


3An objection to the use of chi square might be 
raised here on grounds that the judgment of one 
case was not independent of the judgment of an- 
other. An attempt to meet this objection was made 
by not telling the psychologist how many cases 
were in each criterion group and warning him that 
he was zot to assume that the criterion groups were 
nearly equal in number. Thus, it was hoped that 
the psychologist judged each new case independent- 
ly of how he had judged previous ones. 


puted for a four-fold table.* All results from 
the total impression judgments were negative. 
Predictions were no better than chance under 


all four conditions. Results are presented in 
Table 1. 


Table 1 
Validity of Total Impression Judgments 
Psychologist Typeot Judgment 
Snap Studied Therapist 

A 

xe -151 -054 -400 

$ >.60 >.80 >.50 
B 

x 1.166 156 516 

$ >.25 >.60 >.40 
G 

x? 1337, 1.22 -035 

$ >.20 >.20 >.80 


Interpsychologist and intrapsychologist 
agreement under each condition was also cal- 
culated and was expressed in terms of tetra- 


Table 2 


Tetrachoric r’s Indicating Inter- and Intrapsychol- 
ogist Agreement on Total Impression 


Judgments 
(Italicized numbers refer to intrapsychologist 
agreement) 
» Psychologist 
A B Q 
a a z 
o 8 u $ ~ = 
a 3 Eon = k S kÈ 
BEgadESa FES 
A 
Snap 75 74 44 30 
Studied 87 50 21 
Know i 
thpst. -60 32 
B 
Snap 65 6. 
Studied 3 
Know ~ 46 
thpst. 
27 
å 2 
Snap 
Studied ole 
Roy 7 85 
thpst. s 
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choric r. Tetrachoric r’s‘for the judgments 
between different psychologists ranged from 
+.21 to +.60 and are presented in Table 2. 
Correlations above +.40 are significant at the 
5 per cent level. Five of the correlations 
range above +.40 and they are to be con- 
sidered significant. According to Wilkinson's 
table [3] the probability of obtaining five 
correlations significant at the 5 per cent level 
by chance when nine are calculated is less 
than .0006. 

‘Yetrachoric r’s for the same psychologist 
under Conditions I — III ranged from +.53 
to +.87 and are presented in Table 2. All of 
these correlations are significant at the 5 per 
cent level, although how contaminated they 
are from judgment to judgment is unknown. 
The judges expressed the not unlikely point 
of view that contamination from condition to 
condition was minimal because of the large 
number of cases (109) and the time interval. 

Harris and Christianson’s scoring method. 
Weights for various scores as derived by 
Harris and Christianson [2] in their study on 
the use of the Rorschach in the prognosis of 
therapy were applied to our data. This pro- 
cedure did not discriminate between the cri- 
terion groups (%? =.110, p=.75). 

M responses. An analysis was made of all 
the M responses with regard to extensor or 
flexor quality. It should be noted that the ex- 
aminers did not press the subjects for the 
direction of movement; any such expression 
was completely unsolicited. M’s appeared in 
76 records; in 30 cases there were only 
flexor M's, in 13 cases only extensor, in 12 


cases there were both, and in 21 cases the 
direction of 


flexor M’ 


r » appears to be associated 
improvement in therapy. These data 
seemed promising and are elaborated below. 


Response patterns, An attempt to differen- 


tiate between the criterion groups on the basis 
of diff 


erent patterns of responses was made, 
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Four variables were chosen, not because in 
combination they represented a particular per- 
sonality structure, but because of their im- 
portance as Rorschach variables. These vari- 
ables were R, M, FO¢, and XC. A second pro- 
cedure of this sort was made with five varia- 
bles, R, M, Fe, number of rejections, and 
presence or absence of additional responses. 
The second procedure differs from the first 
in that the last two variables mentioned were 
included because they were regarded as use- 
ful prognostic signs. The hypothesis was that 
those patients with fewer rejections and a 
greater number of additionals would be the 
better therapeutic risks. 

A tabulation method was used to analyze 
the data. Space does not permit complete pre- 
sentation of this method here. See Hammond 
[1] for a detailed description of the method. 

In the first procedure each variable was 
broken into categories of High, Medium, and 
Low." For example, Low R =0 — 15, 
Medium R = 16 — 26, High R = 26+. For 
Low and Medium categories of R, M was 
categorized as follows: Low M = 0, Medi- 
um JJ=1, High M=2+. For the cate- 
gory of High R, Low AJ =2 or less, Medium 
M = 3-5. High M = 6+. F9 was cate- 
gorized as follows: Low F% = 0 — 40%, 
Medium F% as 41 — 60%, and High F% 
as 61% +. EC was categorized in this fash- 
ion: For Low ranges of R, Low 2G = 0, 
Medium 3C = .5 — 1.4, High SC = 15+. 
For Medium ranges of R, Low EC = 0 = 
1.0, Medium SC = 1,5 _ 2.4, High 2C = 
2.5 +. For High ranges of R, Low SC = 0 
= 1.9, Medium SC = 2.9 _ 3.4, High ZC 
=3.5+. 

For the second procedure, R, M, and F% 
remained as described above. Rejections were 
categorized in the same way for all values of 
R, Low rejections = 0, Medium rejections 
=1, High rejections=2+, “Additionals” 
were categorized merely in terms of presence 
or absence. Results from the pattern analysis 
Procedure were negative, By inspection it was 


BDentet ; 
Decisions about the range in categories were 


made from an examination of the data obtained. 
Although 


recognized as a risky procedure, it ap- 
peared to be the most promising one and risks 
would be forestalled by use of a cross-validation 
group, if positive results were obtained. 


jl 
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Fig. 1. Percentage of responses occurring in criterion groups. (See Table 5 for responses indicated 


by numbers in this figure, eg, 1 = R < 20.) 


obvious that the patterns used did not dis- 
criminate between the criterion groups. 

In summary, then, only one a priori method 
of prediction, type of M, seemed even promis- 
ing; the other methods offered no evidence of 
better-than-chance success. 


Inductive Procedures 


The inductive procedures were as follows: 
Single variables: The first step was the 
analysis of single variables, or scores, such as 
M, =C, F%, etc. Each such variable was 
examined to discover whether the percentage 
of persons achieving a certain score differed 


in the criterion groups. For example, the per- 
centage of persons in the criterion groups who 
achieved three or more M’s was compared, 
The procedure for choosing cutting points 
was deliberately that of choosing those cuttin: 
points which seemed empirically most is 
ing. There were two reasons for this pro- 
cedure: (a) The study had now become 
frankly empirical one and Cross-validatio: %4 
planned, and (b) it very so ma 


on became a: 
parent that few large differe a 

neces i 
to be found. eevee EPRE 


Ninety-nine percenta: 
P ges were co 
are presented pictorially in Fig. 1 pena te 
i5 O 
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a method developed by Zubin [4]. It will be 
noted from the figure that the results are 
negative. None of the variables produced sig- 


Table 3 


Rorschach “Signs” Corresponding to Numbers 
In Figure 1 


1. R less than 20 £2. Categories more 


2. R less than 10 than 6 

3. R40 or more 53. Categories more 

4. M presence than 8 

5. M more than 1 54. Rejection presence 
6. M more than 3 55. Cut-off 3 or more 
7. FM presence 56. At presence 

8. FM 4 or more 57. Atmore than 2 

9. FM more than 4 58, Atmore than 3 
10. m presence 59. Sex presence 
11. Add. m presence 60. N or Geog presence 
12. k presence 61. Art/Des presence 
13. k more than 1 62. Nature presence 
14. K presence 63. Geog presence 

“15, FK presence 64. Clouds presence 

16. FK 3 or more 65. Blood presence 

17. F 4or more 66. Fire presence 

18. F 3 or more 67. AD >A 

19. Fc presence 68. F% more than 70 
20. Fe 3 or more 69. F% more than 50 
21. c presence 70. F% less than 30 
22. C' presence 71. F% 60 or more 

23. FC presence 72. F% less than 40 

24. FC more than 2 73. Shading absence 
25. FC more than 1 74. Shading 15% or more 
26. CF presence 75. Shading 20% or more 
27. CF more than 1 76. Shading 30% or more 
28. CF more than 2 77. Sum C=0 

29. FC > CF 78. Sum C less than 2 
30. FCto0 CF 79. Sum C more than 4 
31. CF > FC 80. Sum C less than 1.5 
32. CF to0 FC 81. CF >rce 

33. Presence of CF or FC SumC>3 

34. Presence of C 82. M:Sum C . Same 
35. Human absence as OM/OC 


36. Human more than3 83 
37. Human more than2 84. % last 3:30 or less 
D a presence 85. % last 3:45 or more 
ý more than 1 86. % last 3:40 or more 
= Pee more than 3 87. % C less than 10 
= oe >H 88. % C 20 or more 
» A% 50 or more 89. % C 13 or less 
43. A% 60 or more 90. W% > 50 
44. Ao 30 or less 91. W% 30 or less 
45. Populars 5 or more 92. W% < 20 


= os 2or less 93. W% 45 or more 
- es 8 or more 94. D% 30 or less 


95. D% 40 or less 
96. D% 65 or more 
97. D% 41 -60 

98. S presence 


99. S more than 1 
Se ee PaO i 


+ Mo last 3:24 or less 


49. Aobj Presence 
50. Obj presence 
Si Others presence 


nificant differences between the criterion 
groups.” Table 3 gives a list of the signs 
tested, corresponding to the numbers in Fig. 


a. 

Rules for prediction. After examination of 
Fig. 1, and using the analysis of the M's, 
rules were set up which seemed most likely to 
discriminate between the criterion groups. 
These rules are listed in Table 4. The rules 


Table 4 


Prediction Rules 


I. Considering type of M 

Improvement: 

1. Presence of extensor M and % C = 10 

2. Presence of flexor M, absence of small m, 
FG >93 

3. Presence of flexor M, presence of CF or FC, 
Yo C > 10, absence of object, presence of N 
or G 

4. Presence of M that is neither E or F, ab 
sence of small m, FC > 2, % last 3 < 40 

5. Presence of M that is neither £ or F 
absence of object 

Unimprovement: 

6. Presence of extensor M, presence of CF or 
FOC,%C< 10, presence of object 

7. Presence of flexor M, % last 3 > 40, except 
when FC > 2 

8. Presence of flexor M, % C < 10, CF or FG 
Present, presence of object, and N or G 

9. Presence of M that is neither E or F, pres- 
ence of CF or FC, % C > 10, presence of 
object, N and G absent 

II. Without regard to M 
Improvement: 
10. No small m, EC > 0, % last 3 < 40 


11. Presence of CF or FC, % C > 10 
Unimprovement: 


12. No small m, SC = 0 
13. % C < 10, Presence of object, and N or G 


„ and 


were then applied to a new sample of 104 
cases, of whom 70 were improved, and 34 
were not. Upon application, it was noted that 
the rules were not mutually exclusive. It was, 
therefore, decided that each case would be 
Judged only once. Since it appeared from our 
original sample that we could predict success 
more accurately than failure, if a case fell in- 
to a category predicting success, that category 
was the only one used. If a case fell into more 
than one category, it was put in the one with 
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which the most favorable results had previous- 
ly been obtained in the original sample. It 
should also be noted that many cases do not 
fall under any of these rules and therefore are 
not judged. Results for each rule are pre- 
sented in Table 5. 


Table 5 


Results of Empirical Pattern Analysis 
(First sample N = 50 Improved, 59 Unimproved; 


Second sample N = 70 Improved, 34 Unimproved) 
3 8: Bs g z 
v On bs oo 
= Bow Bw. gs y 
sl Eg cide dga! 33 
eee i ee 
Considering 
type of M 
Extensor M 
21 15 3 12 
(76) + 4 1 0 1 
2 6 
Flexor M 
42 2 0 5 0 
23 3 0 2 0 
E7)t 4 1 4 2 
(8) 5 2 1 1 
11 11 
M neither 
E nor F 
Z 7 2 8 1 
(25) 2 3 41 
(29) e 4 1 1 
4 10 
Without 
regard to M 
#10 4 3 16 7 
211 42 23 28 9 
(212) + ii 5 7 10 
#13) 11 4 9 F 
6 11 


*See Table 4 for rules. Rules are numbered in accord- 
ance with their number in Table 4. f 

{Numbers in parentheses refer to rules which predict 
unimprovement and vice versa. 


The results of the cross-validation study 
are described in detail below and are pre- 
sented in tabular form in Table 6. — 

Predicting Improvement: (a) Empirically 
derived rules for predicting improvement 
which include consideration of M do appear 


to predict improvement better than chance 
(see A, Table 6). (b) Empirically derived 


Table 6 
Validity of Empirical Rules 
A. B. 
Pred. Imp. with M Pred. Imp. W.O. Af 
Imp. Ui. Imp. Ui. 
With rule |30] 4] 34 With rule 44/16] 60 
W.O. rule |40]30[ 70 W.O. rule | 26 lis| 44 
70 34 104 104 
x? = 10.05 34 
p= <.01 p= 4 
©: D. 
Pred. Unimp. with M Pred. Unimp. W.O. M 
‘Imp. Ui. Imp. Ui. 
With rule | 5| 6] 11 With rule [a7 [16] 33 
W.O. rule |65]|283| 93 W.O. rule |53 lasi 71 
70 34 104 70 34 104 
x2 = 2.66 ss 547 
P= .10 $= <.02, 


rules for predicting improvement which do 
not include AZ do not quite reach the usual 
criterion for better-than-chance prediction (see 
B, Table 6). 

Predicting Unimprovement : 
ically derived rules which 
sideration of AZ do not quit 
criterion for better- 


(a) Empir- 
include the con- 
e reach the usual 
than-chance Prediction 
(see C, Table 6). (b) Empirically derived 
rules which do nog include consideration of 
M do predict unimprovement better than 
chance (see D, Table 6). The above Statistical 
Presentation is modified below so that the 
results are made more clinically meaningful. 
For example, one might ask whether these 
data indicate when the use of M in clinical 
prediction is warranted. 
Rules including M : 
predict improvement u 
clude AZ, predictions could be made in 34 cases 
(32% of the total) ; these Predictions proved 
to be correct in 30 instances (see A, Table 6). 
Apparently, when M is present this is a useful 
Procedure, However, when attempting to pre- 
dict unimprovement (using M) predictions 
could be made in only 11 ¢ 
total), 6 of which were Correctly Predicted 
(see D, Table 6). This does not a e 
be a useful procedure, Thus, t mE 


he clinic: 
of M seems indicated when <a jis 


When attempting to 
sing rules which in- 
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provement, but not when predicting unim- 
provement. 

Rules which do not include M: When at- 
tempting to predict improvement using rules 
which do not include M, predictions could be 
made in 60 cases (58% of total) ; these pre- 
dictions proved to be correct in 44 instances 
(see B, Table 6). This seems to be a clinical- 
ly useful procedure, for the psychologist was 
correct about three-fourths of the time. Note, 
however, that the odds are biased in the psy- 
chologists’ favor when predicting improve- 
ment, for the odds are about 2 to 1 that any 
given case in the population will be improved. 
It is for this reason that this rule does not 
quite reach the usual 5% criterion. 

When attempting to predict unimprovement 
using rules which do not include M, the psy- 
chologist could predict for 33 cases (31% of 
the total). The psychologist was correct 
about 50% of the time (see C, Table 6). 
This hardly seems to be a useful procedure, 
even though better-than-chance prediction is 
achieved. Thus, procedures which exclude M 
from consideration seem useful clinically when 
predicting improvement only. 

In brief, then, these data indicate that the 
rules for predicting improvement would be 
clinically useful, with or without the use of 
M, and that the rules for predicting unim- 
provement would not be clinically useful, 
with or without the use of 1.7 The reader 
should note again that in this pop 
diction of improvement is much 
prediction of unimprovement bec. 
distribution of cases, i.e., 
improved cases—thus any 
Provement is more likel 
wrong. 


ulation pre- 
easier than 
ause of the 
there are far more 
Prediction of im- 
y to be right than 


Discussion 


These results Point to th 
factors on the Rors 
predictive 
factors, i.e 
prediction 


is quite probable that they are not the best, 
nor the only rules which might be derived 
from the data. For example, shading responses 
were not considered nor were location re- 
sponses. Other factors may well be considered. 
For example, we used a representative clinic 
sample, without regard to diagnosis or thera- 
pist. It is quite possible that if the patient 
population were stratified with regard to diag- 
nosis and therapist, that greater precision 
might be obtained. However, the results ob- 
tained appear promising and further investi- 
gation seems appropriate. 

On the other hand, the negative character 
of the results of our a priori procedures 
should not be overlooked. In this study, four 
procedures which might reasonably have been 
expected to have predictive value, did not ap- 
proach success. Consider especially the “total 
impression” results. Here intrapsychologist 
agreement was higher than interpsychologist 
agreement. Thus, one might speculate that 
three rather different methods of “total im- 
Pression” judgment were used rather consis- 
tently without success. 

Our conclusion is that while the Rorschach 
test may be used for prognostic Purposes suc- 
cessfully by some psychologists, there is em- 
phatic need for further empirical check; in- 
deed, empirical work may make prognosis 
from the Rorschach explicit and practical.* 


Summary and Conclusions 


1. Rorschach records of 109 unselected vet- 


erans who had been in treatment were used 
to predict outcome of treatment. 


2. Psychologists experienced in the use of 
the Rorschach did not make better-than-chance 
Predicitions of outcome of treatment under 


three separate methods of studying the Ror- 
schach protocols, 


3. Combinations of four variables in one 


instance, and five variables in another, also 
®After this article was submitted for publication, 
an article by G. Filmer-Bennett entitled “Prognostic 
indices in the Rorschach records of hospitalized pa- 
tients” appeared in J. abnorm. soc. Psychol., 1952, 
47, 502-506, in which the author noted that “The 
foregoing results failed to reveal any sharp trends 
in Rorschach performance which were significantly 
related to outcome of treatment or which compared 
With those reported in earlier studies.” 


| 
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failed to discriminate between the criterion 
groups. 

4. The results obtained by Harris and 
Christianson for their group did not predict 
successfully for this group. 

5. There was some evidence that extensor 
M's, when they appear alone in a record, are 
associated with improvement in therapy. 

6. Ninety-nine Rorschach “scores” were 
examined, and did not differentiate between 
the criterion groups. 

7. Rules for prediction obtained on an 
empirical basis, and cross validated, showed 
definite promise of utility. The rule most use- 
ful permitted predictions in about one-third 
of the cases examined, and showed correct 


predictions at the 1 per cent level of confi- 
dence. 


Received July 14, 1952. 
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Rorschach Criteria for Predicting Continuation 
in Individual Psychotherapy’ 


Benjamin Kotkov 
Boston Mental Hygiene Unit, Veterans Administration 


and Arnold Meadow 


University of Buffalo 


This study is the second in a series of in- 
vestigations designed to determine Rorschach 
criteria for predicting continuation in psycho- 
therapy. The hypothesis for the study was 
suggested by the results of an initial study of 
group psychotherapy patients [3]. These re- 
sults had indicated that a group of neurotic 
patients who continued in group psycho- 
therapy had, on the average, higher FC minus 
CF, R, and D% Rorschach scores than a 
matched group of patients who discontinued 
group psychotherapy without the consent of 
the psychotherapist. A weighted combination 
of the three Rorschach scores derived by a 
discriminant function analysis permitted an 
accurate allocation of each patient to a “con- 
tinuing” and “noncontinuing” group in 69 
per cent of the cases. A chi-square test indi- 
cated that this percentage of successful alloca- 
tion was significant beyond the 1 per cent 
level. 

‘The aim of the present study was to deter- 
mine at an empirical level whether the three 
Rorschach variables which were useful 
determining continuation 
therapy could predict the 
individual psychotherapy, 


in 
In group psycho- 
same behavior in 


Subjects and Procedure 


The Rorschach records of twenty-six “con- 


TReviewed in the ini i 
published sai ak Veterans Administration and 


“Director. Th 


falo, for his 
publication. 
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tinuing” and twenty-six “noncontinuing” pa- 
tients were selected at random from the test 
files of the Boston Mental Hygiene Unit, 
Veterans Administration. A patient was classi- 
fied as “continuing” if he attended the first 
nine psychotherapy sessions without severing 
his relation to the clinic. A patient was classi- 
fied as “noncontinuing” if he had accepted in- 
dividual psychotherapy, but ceased keeping ap- 
pointments without the psychotherapist’s con- 
sent before the ninth psychotherapy session.” 

The fifty-two Rorschach records were all 
those of white, male veteran patients referred 
for individual psychotherapy. The patient 
group was a predominantly neurotic popula- 
tion with the exception of a few latent schiz- 
ophrenics and behavior disorders. ‘The age 
range was from nineteen to forty years with 
a mean age of twenty-eight years. The educa- 
tional level of the group ranged from eight 
to fifteen years, with a mean of twelve years. 
There were as many married as single men. 
The majority were of Catholic faith. The oc- 
cupations varied, with a fairly even distribu- 
tion of students, clerks, skilled, semiskilled, 
and unskilled workmen. 

The Rorshach tests had been administered 
by members of the Psychological staff of the 
Boston Mental Hygiene Unit according to the 
Standard procedure described by Klopfer [2]. 
The scoring of each protocol was checked by 
the senior author to insure uniformity and 
accuracy. 

The design of the experiment provides for 
two statistical comparisons: (a) between the 


?The same number of sessions attended was used 


in this study as in the previous group psychother- 
apy study [3]. ald 
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means of the “continuing and noncontinuing 
groups on each of the three Rorschach vari- 
ables, FC minus CF, D%, and R.; and (b) 
between the continuing and noncontinuing 
groups on a weighted Rorschach score ob- 
tained by combining the three variables ac- 
cording to the discriminant function equation 
derived from the previous group psycho- 
therapy study. 


Table 1 


Means of Continuing and Noncontinuing Psycho- 
therapy Groups for Three Rorschach 
Variables 


a o o usma 


P Continuing Noncontinuing 
Variable ED group 
FC—CF +.19 —1.08 
D% 53.88% 45.46% 

R 28.8 16.46 
Results 


The means of the three Rorschach vari- 
ables, FC— CF, R, and D% for the continuing 
and noncontinuing groups of patients are pre- 
sented in Table 1. The data indicate that the 
mean FC minus CF and R scores for the con- 
tinuing group is higher than the corresponding 
means for the noncontinuing group. The tests 
of significance between the means „yield a 
probability level of .01 for the FC minus CF 
mean difference and .02 for the R mean dif- 
ference. The difference between the „mean 
D%’s of the continuing and noncontinuing 
groups is not significant. 


The results of the present experiment which 
used individual psychotherapy patients as sub- 
jects in general parallel the results obtained 
in the previous group psychotherapy experi- 
ment, The mean FC minus CF and R scores 
of the continuing groups of patients are sig- 
nificantly higher than the corresponding means 
for the noncontinuing groups in both experi- 
ments. In both experiments the mean R scores 
for the continuing groups are higher than the 
mean R scores for the noncontinuing groups. 
The test of significance for =. niai 

hotherapy experiment yielded a muci 
ie probability level. The p for the individ- 
ual psychotherapy experiment was 02; for the 
group psychotherapy experiment it was .01. 
The difference between the mean D% for the 


continuing and noncontinuing individual psy- 
chotherapy groups was in the opposite direc- 
tion to that found in the group psychotherapy 
experiments. In the earlier experiment, how- 
ever, the difference had only been significant 
at the .2 level. 

The results of the discriminant function 
analysis performed in the first experiment had 
yielded the equation 


z=00241397x + .00006969.x2 + .00038326xs 


in which x, is the FC minus CF score, xa 
is the D% score and xs the R score.” In the 
present experiment a z score was accordingly 
obtained for each patient by substituting his 
empirical FC minus CF, D9% and R scores 
in this equation. The distributions of z scores 
for the continuing and noncontinuing individ- 
ual psychotherapy groups are presented in 
Table 2. To facilitate comparison with the 
results of the previous experiment, the com- 
parable distributions of the continuing and 


noncontinuing group psychotherapy patients 
are presented in the same table. 


Table 2 
Frequency Distribution of x Scores for Continuing 
and Noncontinuing Psychotherapy Groups 


= 


2 8 wg 

v. BL wS 28 

© score class intervals 4 Ei 3 Ë Ej BE S8 
ESE SEE oe g S 

E52 peg 22 83 

: SEE ZER SE 86 

1. -.00283112 — .00000000 0 3 0 0 
2. .00000000 — .00283112 1 3 0 0 
3. .00283112 — .00566224. 3 4 7 13 
4. 00566224 — 00849336 1 3 5 19 
5. .00849336 — .01132448 6 8 i 47 
6. .01132448 — 01415560 3 4 4 p 
7. .01415560 — .01698672 3 0 9 4 
8. .01698672 — .01981784 2 4 1 2 
9. .01981784 — 02264896 a“ © Bw i 
10. .02264896 — .02548008 2 0 2 0 
11. .02548008 — .02831120 0 0 0 0 
12. .02831120 —.03114232 3 8 f 0 
Total N 26 26 42 56 


Table 2 indicates considerable overlap be- 
tween the continuing and noncontinuin 
group’s distribution of scores. Al] distributions 
are skewed towards the lower end of the : 

ZN ee 
10 en he Sema he constant 
calculations. aii ia 
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score range. There is, however, a greater pro- 
portion of patients with lower z scores in the 
noncontinuing groups than in the continuing 
groups in both the group and individual psy- 
chotherapy distributions. 


Table 3 
Test of Significance between Mean z scores of Con- 
tinuing and Noncontinuing Groups for In- 
dividual Psychotherapy 


Standard Stand- 
Mean = devi- ard Critical 
N scores ations errors ratio p 
Noncon- = 
tinuing 
group 26 006878 00463 .000926 
4.02 <.01 
Continuing 
group 26 014478 .00822 001645 


The results of the test for the significance 
between the means of individual psychotherapy 
continuing and noncontinuing groups are pre- 
sented in Table 3. Table 3 indicates that the 
continuing group has a higher mean z score 
than the noncontinuing group. Since the direc- 
tion of this difference was postulated by hy- 
pothesis, a one-sided significance test is justi- 
fied and the critical ratio is accordingly signifi- 
cant at the 1 per cent level. 

Empirical inspection of the z-score frequen- 
cy distributions of the group psychotherapy 
patients indicated that the value z=.01132448 
represented the cutting point which produced 
the minimum overlap between the continuing 
and noncontinuing groups. In the present ex- 
periment, if we call all those cases above this 
point continuing and all th 
as noncontinuin 
dicted 36 corre 


computed. Th 
which is sign 
level. 


Discussion 


An evaluation of the results of both experi- 
ments sug 


e gests the conclusion that the FC 
minus CF and R varjables clearly differentiate 
continuing and noncontinuing patients 
whether ir. group or individual psychotherapy. 
The second conclusion which emerges from 


the data is that the D% is probably not a use- 
ful differentiating index in either type of psy- 
chotherapy. 

When the three Rorschach variables are 
combined into one predictive index by a dis- 
criminant function analysis, the results for 
the individual psychotherapy experiment close- 
ly parallel those obtained in the group psycho- 
therapy experiments. In both cases, the anal- 
ysis yielded correct predictions in precisely 69 
per cent of the cases. 

In the group psychotherapy experiment, the 
discriminant function equation and cutting 
point z score were empirically derived. Ac- 
cordingly, it was expected that the experi- 
mental error would reduce the accuracy of 
prediction in the individual psychotherapy ex- 
periment. The striking similarity of the re- 
sults of the second experiment to those of the 
first greatly increases the degree of confidence 
with which the relationship, 
expressed by the discriminant function equa- 
tion, can be accepted. However, future pre- 
dictions would probably be more accurate if 
only the FC-CF and R variables were utilized 
in the equation. 
; The experimental results 
Impressive when certain diff 
the designs of the 
closely 


mathematically 


are even more 
erences between 
two experiments are more 
examined. The type of subjects used 
in the experiments differed in many respects. 
In the first experiment 7] per cent of the 
subjects were obese nonveteran patients, and 
29 per cent were neurotic veteran patients. All 
of the patients of the second experiment were 
veterans, most of whom were neurotic. 
Thirty-three per cent of the subjects of the 
first experiment were over 40 years of age. 
All of the patients of the second experiment 
were under 40 years of age. Over 50 per 
cent of the patients in the first experiment 


were women. The patients in the second ex- 
periment were all men, 


; Despite the differen 
Jects studied, 
Suggests that a 


ces in the types of sub- 
the similarity of the results 
t least some of the personality 
factors which determine continuation in group 
Psychotherapy determine continuation in in- 
dividual psychotherapy. 

ther Personality factors not measured by 
the methods employed 


[ hod: in these experiments 
might indicate some 


differential reaction 
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to the two types of psychotherapy. Similarly, 
factors other than those related to personality, 
such as method of psychotherapy, personality 
of psychotherapist, group composition, etc., 
may also be important determinants of 
whether a patient continues or discontinues 
psychotherapy. 

The problem arises as to how to account 
for the results of the two experiments on a 
theoretical level. 

It is assumed that the motivation of pa- 
tients who undertake psychotherapy is am- 
bivalent. On the one hand, they wish to con- 
tinue psychotherapy in order to relieve their 
symptoms. On the other hand, they wish to 
discontinue psychotherapy because of the 
anxiety aroused by the psychotherapeutic pro- 
cess. f 

It is further assumed that patients with 
greater FC minus CF and R scores have a 
greater capacity to tolerate the anxiety aroused 
by the psychotherapeutic process and accord- 
ingly remain in psychotherapy. Conversely, 
patients with relatively low FC minus CF 
and R scores have a lesser capacity to tolerate 
the anxiety aroused by the psychotherapeutic 
process and accordingly, discontinue psycho- 
therapy. 

There are several facts which support this 
second assumption. Williams [5] reports a 
positive correlation between the number of 
FC responses and a subject’s capacity to with- 
stand experimentally induced stress. A study 
by Eichler [1] indicates that experimental 
stress produces a significant decrement in the 
R variable. It is possible that the patients 
with low FC minus CF and R Rorschach 
scores at the beginning of psychotherapy have 
initially a greater amount of anxiety than the 
patients with higher FC minus CF and R 
scores. They are accordingly relatively unable 
to tolerate the additional amount of anxiety 
induced by the psychotherapeutic process. 

Rogers, Knauss, and Hammond [4] have 
recently published the results of a study 
similar to the one reported here. These 
authors attempted to determine whether the 
Rorschach test would aid in predicting wheth- 
er an outpatient would return to the clinic for 
five or more interviews. On the basis of their 
results, the authors conclude that this be- 
havior cannot be predicted by the Rorschach 


test, although they qualify their conclusion 
with the proviso that future, more extensive- 
ly controlled studies might yield positive re- 
sults. The contrasting results of the study of 
Rogers, et. al., and those of the present study, 
require some theoretical interpretation. 

A possible explanation can be formulated 
in terms of the differences in the methodology 
employed in the two studies. Rogers, et. al. 
used two methods for analyzing their Ror- 
schach data: (a) clinical impression judg- 
ments of the entire Rorschach protocol, and 
(4) statistical comparisons of ninety-nine in- 
dependent scores or signs. An objection to the 
use of the first method is that there was in- 
sufficient reliable information about the re- 
lationship of the independent variables (the 
Rorschach factors) to the dependent variable 
(continuation in therapy) to permit the for- 
mulation of a fruitful hypothesis. This judg- 
ment is admittedly a “Monday morning 
quarterback” type of criticism, but it is at 
least supported by the results of the Rogers 
study. 

The sign method involves similar difficulties. 
The cutting points for each of the “signs” are 
derived on an a priori basis. The previously 
suggested point, that the present area of in- 
vestigation is a relatively unexplored one, may 
also be considered as an objection to the use 
of a priori cutting points. In addition, the 
sign method is subject to the criticism that it 
violates the Gestalt quality of the classical 
Rorschach interpretive procedure. 

The discriminant-function method em- 
ployed in the present series of studies preserves 
the advantage of a method which provides 


for the simultaneous consideration of sever 


al 
Rorschach factors w 


Rorsel ithout sacrificing the ob- 
jectivity afforded by precise quantification. 


Summary 


Results of a previous study of group psy- 
chotherapy patients suggested the hypothesis 
that continuation or noncontinuation in psy- 
chotherapy was a function of three Rorschach 
factors, FC minus CF, D%, and R. The aim 
of the present study was to test this hypoth- 
esis on individual psychotherapy patients, 

Two methods were employed. The first 
method consisted of comparing the means ne 
each of the three Rorschach varicbles of a 
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group of patients who discontinued individual 
psychotherapy with the means on the same 
variables of a group of patients who continued 
individual psychotherapy. The second method 
consisted of comparing the same continuing 
and noncontinuing groups of patients on a 
weighted Rorschach index. This index was 
obtained by the solution of a discriminant 
function equation empirically derived from 
the previous investigation of group psycho- 
therapy patients. Twenty-six continuing and 
26 noncontinuing clinic outpatients were used 
as subjects. The following results were ob- 
tained: 

1. The average FC minus CF and R 
scores of the continuing patients were signifi- 
cantly higher than those of the noncontinuing 
patients. 

2. The difference between the two groups 
of patients on the D% variable was not sig- 
nificant. 

3. The discriminant-function-weighted Ror- 
schach index yielded a correct prediction in 
36 out of 52 cases. A chi-square test of the 
Statistical significance of this prediction re- 


sulted in a probability value of less than 1 
per cent. 


The results are interpreted in terms of an 
hypothesis which postulates that patients with 
relatively high FC minus CF and R Ror- 
schach scores have a greater capacity to toler- 
ate the anxiety aroused by the psychothera- 
peutic process than patients with relatively 
low FC minus CF and R Rorschach scores. 
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It is implied in the literature that some 
Rorschach scoring categories have relatively 
distinct meanings: that is, they are related to 
independent personality variables. However, 
there is relatively little experimental work on 
the demonstration of this univocality. Hypoth- 
eses often engendered from a Rorschach pro- 
tocol seldom can be tested or perhaps more 
important, they do not conform to the formal 
conditions of testing hypotheses. The terms 
in the Rorschach are rather vague, ambiguous, 
and almost defy being operationally defined ; 
one need only examine words like “libidinal 
urges,” “central anxiety,” etc. “The problem 
facing the scientific psychologist is not, is the 
Rorschach valid, but, what aspects of the Ror- 
schach are valid, and what are its limitations 
and uses?” [5, p. 306]. Wittenborn [9] using 
a factorial technique has shown that there is 
in fact much overlap in the scoring categories 
of the Rorschach using a college population. 
In an unpublished paper, Schroder [8] also 
has found much overlap in the Rorschach cate- 
gories in a sample composed of individuals hav- 
ing Binet IQ’s of 60-80 and CA’s of 11.5 
to 13.0. 

It would appear on the basis of traditional 
Rorschach interpretations that scores are unre- 
lated to the verbal fluency of the subject. 
From the point of view taken in this paper 
and implied by others [3] such a positive re- 
lation is expected to hold. In the clinical situ- 
ation, one often sees the “verbal” individual 
produce large numbers of responses and with 
it a rather large number of determinants. The 
question then arises do these determinants ac- 


1Read in part at the Midwestern Psychological 
Association meetings 1951. The writer wishes to 
thank Dr. J. B. Rotter and Dr, R. Wherry for their 
aid in this investigation. 
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tually give us the “core? of the personality 
or are they reflections of the patient’s ability 
to verbalize. It was the hypothesis of this 
study that an explanation of the obtained 
overlap might be found in the possible rela- 
tionship of the scoring categories to general 
verbal fluency. The Rorschach protocol is 
after all a sample of the subject’s verbal rep- 
ertoire. For example, it is virtually impossible 
to score for movement if the subject does not 
employ an action term in his response; like- 
wise the scoring of shading implies the pres- 
ence of certain descriptive terms in the proto- 
col. If it were demonstrated that various Ror- 
schach categories are not independent of each 
other, and if it were demonstrated at the same 
time that they are related to external criteria 
of verbal facility, then one would be tempted 
to question the validity of certain Rorschach 
interpretations. Factor analysis appeared to be 
the most useful technique for approaching this 
problem. If, as some Rorschach workers claim, 
the several determinants are independent, they 


should manifest themselves as isolated factors 
in a factor analysis. 


Subjects and Procedure 


A group of thirty college students, male and 
female, stratified on intelligence as measured 
by the Ohio State Psychological Examination 
participated in this investigation. Three u 
dents were selected randomly from each decile 
of the OSPE. None of the subjects had taken 
the Rorschach prior to the present situation. 
The experimental situation consisted of twa 
parts, both of which were recorded by the 3 
of a concealed microphone. In Part 1 the sib 
Jects gave verbal descriptions of five Tense. 


cal situations. In Part 2, ea z 
ts » each subject = 
ministered the Rorschach test, —- 


` 
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“Fhe hypothetical situations used are as fol- 
lows: 


1. What are the two main streets which inter- 
sect in your town? Just imagine that you are back 
there now on the corner. It is 12 o'clock noon on 
Saturday. Tell me at length everything you see and 
what is happening. 

2. I would like you to tell me as much as you 
can as to what you do for recreation. Tell me all 
about it. 

3. Suppose that you have not had a vacation for 
a long period of time and one day someone gives 
you all the money that you need to go on a trip. 
Tell me at length all about the trip that you would 
take. 

4. Do you know where the oval is? Well, just 
imagine that you are in the center of the oval and 
you are telling some friend from home about every- 

thing you see. What would you tell them. 
5. What is the easiest thing for you to talk 
about? Tell me as fully as possible all about it or 

a modification of this to fit the subject’s topic. 


At the termination of Part 1, the subject 
was told that the experimenter wanted him to 
do something different. At this time the Ror- 
schach was administered employing the in- 
structions advocated by Beck. In order to mini- 
mize the possibility of experimenter bias in- 
fluencing the number of determinants, a rigid 
inquiry technique was employed. After the 
free association period, the examiner asked the 
following questions for each response pro- 


duced: 


1. Show me the 
2. What gave you the idea that it was a - - - -? 


3. Can you tell me anything else that suggested 
that it was a 


After the above questions were asked, no 
attempt was made to probe for additional in- 
formation. The Rorschachs were scored using 
the notations employed by Beck. 


For present purposes verbal fluency was 
measured by counting the total number of 
words spoken, number of adjectives, and num- 
ber of verbs. 

The following criteria were used to evaluate 
the verbal output. 


Nouns used as adjectives are counted as adjec- 
tives. Examples: psychology course; toy rifle. 

Proper nouns used as adjectives are not counted. 
Examples: Baker Hall; South America. 


Where colloquialisms or incorrect grammar are 
used, part of speech designated is that of the sub- 
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ject. Examples: It’s real quiet. Real here is an ad- 
verb and quiet is the adjective. 

Verbs used as nouns (ferunds) are not counted. 
Example: I can't get much 
Studying is the gerund. 

Dangling participles are counted as adjectives. 
Going into Columbus, High Street runs north and 
south. 


too studying done. 


Verbs used as adjectives, participles, are counted 
as adjectives. Example: You'd probably see people 
standing in groups. Standing modifies people. 

Possessive forms of pronouns are not counted as 
adjectives, possessive adjectives. 

The verb fo be was not counted as a verb. 

Auxiliaries were not counted as separate verbs. 
These were part of the main verb. 

When standing alone they were counted. 

Infinitives were not counted, 

Limiting adjectives were not counted. Examples: 
This, those, some, many. 


Ah’s and similar “feeling” statements were not 
counted as words. 


Not all of the Rorschach scoring categories 
were used in study. The method used in se- 
lecting the scoring categories was that these 
categories be relatively unaffected by the sub- 
ject’s verbal fluency; for example “affect” and 
“anxiety.” The Rorschach attempts to get at 
basic personality variables such as “fantasy,” 
“emotionality,” “control,” etc. From Ror- 
schach literature it was felt that selecting the 
crucial determinants would not be related to 
verbal fluency. Although the superficial aspects 
of personality vary as a function of the situa- 
tion, the core of the personality remains con- 
stant. On this basis, it would be expected that 


verbal fluency should be unrelated to Ror- 
schach determinants. 


Product-moment correlations were obtained 
among all the variables used at the present 
time. These variables included Rorschach 
scores and verbal measures. The resulting cor- 
relations were then subjected to a factor analy- 
sis using a multiple extraction process to fa- 
cilitate handling of the data. The criterion of 
simple structure was employed in the rotation 
of the factors extracted. 

Inspection of the correlational matrix, 
Table 1, shows, for this sample, disagreement 
with expectations derived from Rorschach the- 
ory. An interesting finding is obtained when 
M is correlated with Sum C. The obtained 
correlation of 0.54 is difficult to interpret stay- 
ing within the realm of Rorschach theory ; one 
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Table 1 


Intercorrelations of Rorschach Determinants and Verbal Measures 


Total Adjec- 
OSPE Words tives 


X 31 33 
31 x 91 
.33 Sl x 
.28 97 82 
-20 40 33 
.07 1 A8 
lS -09 -05 
wll ol 33 
A9 -04 08 
.22 66 -57 
33 15 15S 


Verbs M R Wl XC A+Ad% Y y 
-28 20 07 15 ad 19 22 +33. 
97 -+0 .51 -09 .51  —.04 -66 15 


82 33 8 05 33 08 57 45 


X -42 45 AS 56-01 +62 


42 X Al 14 54 -26 8 52 
1 


45 Al X —.29 -67 -.16 81 : 

15 -14 -.29 X As 04 07 03 
56 54 -67 +13 X -39 79 30 
“Ol -.26 -16 04 -.39 X —.17 -.26 
-62 AS 8100 -.07 -79 -17 X 24 
15 52 17 03 30 -.26 24 x 


might expect that the correlation should ap- 
proximate zero or there should be an inverse 
correlation for a “normal” population. It 
seems necessary to conclude for this sample 
that there is a moderate degree of overlap 
between the JZ and G categories. Another 
pertinent finding is the correlation of 0.79 
between Y and C. This suggests that these 
two determinants are not as distinct as 
claimed in the Rorschach literature. Accord- 
ing to Rorschach theory, the correlation 
should approximate zero; it would seem rather 
difficult to maintain that Y and C are measur- 
ing different behaviors. 

The factor analysis was based on thirty 
cases. With a sample of this size, the result- 
ing factor loadings should be interpreted with 
some degree of caution. It is only when the 
loadings go above approximately .30 that 
some importance can be attached to them. 


Table 2 
Factor Matrix 

Verbal 
Variable Intelli- Produc- Elab- Individ- 

gence tivity oration uality 
OSPE 67 03 -02 -03 
Total Words 50 34 10 06 
Adjectives 47 41 02 -03 
Verbs 39 32 39 05 
M 30 32 12 59 
R 10 96 01 00 
W % 33 -31 30 09 
zC 15 58 70 33 
A+Ad% 31 29 -13 -52 
x 35 82 40 -01 
y 43 15 -03 58 


Four factors were obtained from a factor 
analysis of the correlational matrix, Table 2. 
The first factor has its highest loading on the 
OSPE with the next highest occurring on 
the verbal measures. The variables Y, I’, M, 
and J#°% also have appreciable loadings on 
the first factor obtained. These are behavioral 
indicators which contribute to the loading of 
this factor but which should not do so accord- 
ing to Rorschach theory. The hypothesis 
might be ventured that the Rorschach deter- 
minants are not indicators of different be- 
havioral manifestations but rather a priori 
categories which have relatively little inde- 
pendence. Perhaps Y, V, and Af reflect the 
ability to verablize in a testing situation. If 
the subject cannot express himself verb 
becomes almost impossible to score shading 
and vista determinants. Shading responses are 
supposed to indicate depression; but if the 
individual is depressed and refuses to verbal- 
ize, it is questionable whether or not he will 
produce Y responses. The first factor will be 
referred to as one of “Verbal Intelligence.” 
Since Y per cent and M do not have high 
rs — igen Ni is questionable that 

ney are adequate indicators of i i 
This finding is in keeping ot ke poa 
[1] which have shown that little relationshi 
if any, exists between M and intelligence i 
_ The second factor extracted is interesting 
is view of the fact that some Rorschact. 
workers feel that there js relatively high į 
dependence of Rorschach detention his 
factor will be referred to as one of “Py i 
tivity.” Variable R has by nies 


5 Í A 
loading which is followed by yor ing Pa 


ally, it 
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One conclusion appearing warranted for the 
sample used in this study is that the more 
responses the subject gives, the greater the 
possibility of giving some form of color or 
shading responses. Similar results have been 
obtained by Wittenborn [9] and by Schroder 
[8]. Again we see that Rorschach determi- 
nants have much in common; such being the 
case, some of the Rorschach categories might 
profitably be deleted or combined. 

The third factor obtained is referred to as 
an “Elaboration” factor, that is the extent 
to which the individual can describe his 
specific perceptions. Color and shading appear 
to contribute a maximum to this factor. As 
with the previous factors we see that the color 
response is not a distinct category but is re- 
lated to the other determinants. “Anxiety” 
and “affect” should not appear correlated 
for a “normal” Population to the extent that 
they do in this study as well as in that by 
Wittenborn. 

The last factor extracted is called an “In- 
dividuality” factor. Movement, vista, and 
color have high Positive loadings while the 
animal percentage has a high negative loading. 
This factor agrees somewhat with Rorschach 


literature in that M and A are inversely re- 
lated. 


Summary 


Thirty undergraduate students were ad- 
ministered individual Rorschachs. The sub- 
jects also gave verbal descriptions of five 
hypothetical situations. Intercorrela 
obtained for some of the Rorschai 
categories and three verbal descrip 


tions were 
ch scoring 
tive scores, 


The correlations were then subjected to a 
factor analysis. The following four factors 
were obtained: “Verbal Intelligence,” “Pro- 
ductivity,” “Elaboration,” and “Individual- 
ity.” From the loadings on some of the factors, 
for the present sample, it appears that Ror- 
schach determinants are related to language 
measures. Specific Rorschach determinants are 
sometimes closely related to other determi- 
nants, in this matrix, although they previously 
have been considered relatively independent 
of the related variables. An analysis of the 
factors suggests that some revision is called 
for in the categories of Rorschach scores, and 


consequently the interpretations of these cate- 
gories. 
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The Effectiveness of Rorschach Elements in the 
Discrimination Between Neurotic and Am- 
bulatory Schizophrenic Subjects” 


Glenn W. 


Veterans Administration 


Since its introduction in 1921, the Rorschach 
test [18] has gained widespread use as a tech- 
nique for the understanding and interpretation 
of personality. Some clinicians have developed 
qualitative and quantitative signs to aid in the 
differential diagnosis between nosological 
groups. Miale and Harrower-Erickson [11] 
proposed nine “neurotic signs” to distinguish 
between ‘neurotic and normal subjects. Ror- 
schach [1, p. 233] contended that certain signs 
were pathognomonic for schizophrenia. In a 
preliminary study, Harrower-Erickson [5, p. 
114] maintained that her signs might prove 
to be promising in discriminating between 
neurotics and psychotics. 

The purpose of this study was to determine 
whether there are statistically significant group 
differences between neurotic and ambulatory 
schizophrenic subjects with respect to certain 
Rorschach elements and signs. The investi- 
gation is actually a combination “element-inci- 
dence and sign” study since it involved both a 
preliminary search for group differences in 
specifically defined elements preparatory to the 


1This article is based upon a dissertation sub- 
mitted by the writer in partial fulfillment of the 
requirements for the Ph.D. degree, University of 
Pittsburgh, 1950. 


*Published with the permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who assumes no 
responsibility for the opinions expressed or conclu- 
sions drawn by the author. 


The writer is indebted to Dr. Roy M. Hamlin, 
Chief Clinical Psychologist of the Western Psy- 
chiatric Institute and Clinic, University of Pitts- 
burgh, Pittsburgh, Pennsylvania, and formerly 
Chief Clinical Psychologist, Veterans Administra- 
tion Mental Hygiene Clinic, Pittsburgh, Pennsyl- 
vania, for a critical reading of this paper. 
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formulation of signs, as well as the employ- 
ment of signs previously utilized. The sign 
approach has been used since it is an objective 
technique which indicates the salient features 
in an individual’s personality structure with a 
minimum expenditure of time and effort. This 
type of investigation holds that the various 
components of the Rorschach test may be 
utilized singly or in combination, as contrasted 
with the intuitive or global approach alone. 
Piotrowski [14, 15, 16] described ten Ror- 
schach signs for the identification of patients 
with intracranial involvements. Twenty schiz- 
ophrenic signs were gleaned from the literature 
by Klopfer and Kelley [10]. Buhler, Buhler, 
and Lefever [2] devised a “Diagnostic Sien 
List” to aid in the establishment of diagnostic- 
sign patterns for different clinical groups. 
Ross [19] applied the sign techniques of Pio- 
trowski and of Miale and Harrower-Erickson. 
Davidson [4] reported a high correlation be- 
tween personality patterns of children as classi- 
fied by an othodox us of the Rorschach test 
and personal and social adjustment 


in order to roc 
; ur 
a general adjustment rați : z 


personality changes in per: 
chotherapeutic treatment, 
ployed 22 Rorschach fact 


4 ors or pa 
adjustment. Patterns of 


Subjects 


ting between them diagnostically 
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and the schizophrenic groups were divided 
into two numerically equal subgroups by the 
odd-even method so that there were four re- 
search groups: 50 neurotics and 50 schizo- 
phrenics for the original investigation, 50 dif- 
ferent neurotics and 50 different schizophren- 
ics for the replication study. Each subject 
chosen had a service-connected disability for 
either neurosis or schizophrenia. Furthermore, 
the diagnosis must have been confirmed 
currently by a psychiatrist in the installation 
where the patient was seen for diagnosis, 
treatment, or both. 

It was impossible to determine whether a 
Rorschach test had been administered prior 
to the service-connected diagnosis and might 
have had some influence upon this diagnosis. 
It is recognized that most Veterans Adminis- 
tration installations do employ the Rorschach 
test almost routinely and that such results are 
utilized by many psychiatrists in arriving at 
a diagnosis. Complete control over this vari- 
able was not feasible within the scope of this 
study. Presumably, a patient would not be 
placed in either diagnostic category without 
one diagnosis little influenced or uninfluenced 
by Rorschach results. In Practice, diagnoses 
continuing over a period of time are based 
primarily upon clinical behavior rather than 
upon test results. 

Fach neurotic subject had been interviewed 
on an outpatient basis at the Veterans Admin- 
istration Mental Hygiene Clinic, Pittsburgh, 
Pennsylvania. Forty-four of the schizophrenic 
subjects were chosen from the same installa- 
tion; 42 had been seen at the Veterans Ad- 
ministration Mental Hygiene Clinic, Newark, 
New Jersey: and 14 were selected from the 
neuropsychiatric wards of the Veterans Ad- 
ministration general hospitals at Aspinwall, 
Pennsylvania, and Butler, Pennsylvania. The 
ambulatory schizophrenic subjects used were 
individuals who stil] maintained some contact 
with reality and had not deteriorated to the 


4 » Deshon Hospital, Butler, Pennsyl- 
vania; Dr. Howard W, Goodman, Aspinwall Hos- 
pital, Aspinwall, Pennsylvania; Dr. Roy M. Ham- 
lin, Mental, Hygiene Clinic, Pittsburgh, Pennsylva- 


nia, and Dr. Samuel B, Kutash, Mental Hygiene 
Clinic, Newark, New Jersey. 


extent that constant hospitalization was indi- 
cated. 

Only male, white, veterans of World War 
II were used. The schizophrenic subjects from 
the Pittsburgh and Newark areas were amal- 
gamated in a random fashion; there was no 
significant difference between the original and 
the replication studies with respect to the 
number of Pittsburgh and non-Pittsburgh 
cases involved. The two nosological groups 
were equated on the basis of age, intelligence, 
and education. Ages ranged from 19 through 
38. Educational levels varied from the sixth 
grade through one year of graduate school. 
Full-Scale Wechsler-Bellevue Intelligence 
Quotients ranged from 78 through 135. The 
compared groups were not at all significantly 
different with respect to age, intelligence, and 
education. 

Procedure 


Certain factors, ratios, patterns, and signs, 
designated as elements, had been compiled 
previously into a Rorschach Element List® 
composed of 86 items. Many of the elements 
tested are not signs in the strict sense of the 
word. A number of them are simply the vari- 
ous location, determinant, and content factors 
as used by Hertz [6] and Klopfer and Kelley 
[10]. Some are percentages, ratios, differences, 
and combinations of factors extracted from 
sign lists and techniques employed by Muench 
[12], and Klopfer and Davidson [9]. Some 
are qualitative characteristics which have been 
defined quantitatively and checked to indicate 
their presence. Still others are signs, in the 
accepted sense, which have been adopted or 
adapted from devices utilized by Harrower- 

» Buhler, eż al [2], and Piotrow- 

ski [14, 15, 16]. 
f Each Rorschach protocol was scored by the 
investigator from the original verbatim copy 
according to a prescribed procedure which may 
be described as a modified Klopfer system. 
orm accuracy, location, and populars were 
checked against Hertz’s Tables [6]. In order 
to check the accuracy of the scoring, a 
sampling of the records was rescored inde- 
pendently by another experienced Rorschach 
5The descriptive definitions of the elements used 


can be found in the unpublished doctoral disserta- 


tion of the writer [17] on file in the University of 
Pittsburgh library. 
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worker, using the same scoring guides, after 
which a percentage of agreement was calcu- 
lated. Upon completion of the scoring process, 
the items on the Element List were tabulated 
for each individual record and these tabula- 
tions were amalgamated for the nosological 
groups under consideration. The 86 Rorschach 
elements were as follows: 


I. Scoring Factors 


weighted 
57. [FC — (CF + C)] weighted 
58. Fk + FK + Fe + FC' 
59. F : (Fk+ FK + Fe + FC’) 
60. M + FC — (CF + C) 
61. M — FM 
62. H — Hd 
63. Sum C (weighted) 
64. M : Sum C (weighted) 


V. Pathological Signs (Check presence) 


65. 
66. 
67. 
68. 
69. 
70. 
71, 
72. 
73. 
74. 


75. 
76. 


7%. 


78. 
79. 


80. 


81. 


Perseveration 

Impotence 

Perplexity 

Automatic phrases 

Color naming 

Shading shock 

Color shock 

Description 

Significant comments 
Abstraction and symbolism 
Confabulation 
Contamination 

Sex confusion or unusual handling 
Position 

Turning 

Edging 

Ü= 


t: 20. ¢ 

4 p 21. FC 

3. Dr 22. C'F 

4.8 23. C' 

5. Do (oligophrenic) 24. FC 

6. M 25. CF 

7. M+ 26. C 

8. FM 27. P (popular) 
9, m (Fm, mF, m) 28. O (original) 
10. Fk 29. H 

11. AF 30. Hd 

12. k 31.4 

13. K 32. Ad 

14. KF 33. At 

15. FK 34. Sex 

16. F + 35. Ar (artificial) 
17. F— 36. Na (natural) 
18. Fe 37. Pathognomonic 
19. eF content 

38. Pathological 
content 


II. Responses and Timing 
39. R (number of responses) 
40. T/R (average time per response) 
41. Reaction time to cards without color (I, IV, 


V, VI, VII) 

42. Reaction time to cards with color (II, III, 
VIII, IX, X) 

43. Per cent responses to color (responses to 
VIII, IX, X) 

44. Per cent responses to shading (responses to 
IV, VI, VII) 

III. Form-Level Rating (FLR) 
45. Total 


46. Average per response 
47. Average per response (noncolor) 
48. Average per response (color) 


IV. Patterns and Ratios 


49. F % 

50. F + % 

51. FM + total m : Fe + total c + total C’ 

52. A (A + Ad) % 

53. H + A : Hd + Ad 

54. W :M 

55. R + % 

56. [(Fk + FK + Fe + FC’) — (RF +k + 
KF+K+cF+e+CF+C')] 


82. Self-reference 
83. Pathological verbalization 


VI. Miscellaneous 
84. “wW” 


85. Rejections or failures (I through X) 
86. Succession 


Chi square and its probability values were 
utilized as the statistical tools for a test of 
significance of the difference between the two 
groups with respect to each element on the 
Rorschach Element List. In order to exercise 
some control over the possible influence of the 
subject’s number of responses (R) upon cer- 
tain category scores, two precautions were 
taken. First, the usual method of converting 
raw scores into percentages by dividing by R 
was employed where applicable, Secondly, an 
adaptation of a method advocated by Cio - 
bach [3] was utilized to aid in partiallin A 
differences in R. Each nosological grou yes 
divided at the approximate median of in R 
pales: subgroups labeled “Brief” and 

Longer” for separate tests of significa I 
the p values for these two subgrou aie f 
by less than 0.25 on each element the “p oe 
and “Longer” subgroups were fF gga! 
only the “total” chi square and qed ot 

or 


` 
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the element was considered. However, . 
p values for these two subgroups differe y 
0.25 or more, each “Brief” and Longer 

subgroup was tested separately by chi square 
for significant differences. In order to obtain 
a 2X2 table for the application of chi square, 
each element or element subgroup was dicho- 
tomized as near as possible to the median ob- 
tained by inspection. Elements scored for 
presence alone were dichotomized on the basis 
of presence or absence. Yates’s correction for 
continuity [7] was used with all elements ex- 
cept one. Another correction was made for the 
few elements the cell frequencies of which 
were less than five. Because of small cell fre- 
quencies, several elements with similar theo- 
retical meanings were combined; a few others 
could not be treated statistically for the same 
reason. 

Since Rorschach factors are known to vary 
from one sample to another, further confirma- 
tion of the results of the original study was 
considered worth while. Those elements which 
revealed differences between groups at the 10 
per cent level of confidence or better were 
singled out for additional study. The 10 per 
cent level was chosen as the cut-off point to 
allow for the inclusion and investigation of 
borderline factors. Those elements were re- 
tested on another sample of identical size em- 
ploying the same techniques used in the origi- 
nal investigation. 

Certain limitations of this investigation are 
recognized quite frankly. A major problem in 
dealing with nosological groups is diagnosis, 
especially where there is an overlapping of 
symptoms as in the case of neurotics and 
ambulatory schizophrenics. The accuracy and 
consistency of psychiatric diagnoses have been 
questioned frequently. In this study, incon- 
sistencies of diagnosis were kept to a minimum 
by two procedures: (a) the selection of sub- 
Jects was dependent upon two diagnostic judg- 
ments per individual with a time lapse between 
diagnoses; and (b) psychiatric diagnosis in 
both the armed forces and the Veterans Ad- 

ministration employs a well-standardized, tabu- 
lated, and similar plan. A second limitation 
lies in the Problem of the homogeneity of the 
nosological groups under consideration since 
all neurotic subjects we 


: ect re selected from one 
mental hygiene clinic whereas the schizophren- 


ics were chosen from three other installations 
in addition to the one just mentioned. How- 
ever, both clinics are conducted under similarly 
oriented psychiatrists. Moreover, since deter- 
iorated schizophrenics are not assigned per- 
manently to the two hospitals, it would appear 
permissible to include schizophrenic patients 
from these hospitals under the general classi- 
fication of ambulatory schizophrenics. A third 
limitation centers in the applicability of the 
findings. This study is concerned with groups, 
and any conclusions derived therefrom are ap- 
plicable to similar groups alone, in the strictest 
interpretation. Individuals are the primary 
concern of clinicians. However, many persons 
feel that group results may serve as a base of 
operations for use in individual cases. 


Results 


With respect to the major scoring categories, 
the percentages of agreement on the scoring 
accuracy check are as follows: location, 90; 
determinants excluding form quality, 87; form 


quality of determinants, 88 ; content, 92; popu- 
lars, 82; and originals, 33. 


Table 1 
Elements Showing Significant Group Differences 
on Both Original Investigation and 
Replication Study 


f Replica- 
Original tion Group 
Element investigation study exceeding 
chi chi on element 
square $ square p specified 
Ave. 
FLR 7.844 002 9.000 005 Neurotic 
Ave. 
FLR 4.000 .05 4.910 03 Neurotic 
(non- 
color) 
R+% 7844 .007 5.762 .02 Neurotic 
Persevera- 
ton 3.646 .06 5.018 .03 Schizophrenic 
Confabu- 
lation 6.498 .01 4.158 .04 Schizophrenic 
Pathologi- 
cal Ver- 
baliza- 
tion 


8.678 .006 8.384 .006 Schizophrenic 


According to the established criterion, 
twenty elements are influenced by the number 
of R. Only 19 of the 79 elements finally tested 
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out in this investigation show significant dif- 
ferences at the 10 per cent level or better be- 
tween the neurotic and the ambulatory schiz- 
ophrenic groups. They are: S (Brief); M% 
(Longer); FC’% (Longer); P% (Total) ; 
Ho (Longer); T/R; RT, Color; Average 
FLR; Average FLR, Noncolor; Average 
FLR, Color; Succession; F+%; W: M 
(Longer); R + % ; Fk + FK + Fe + FC’ 
(Longer); Perseveration; Shading Shock; 
Confabulation; and Pathological Verbaliza- 
tion. 

The six elements which revealed significant 
group differences at the 10 per cent level of 
confidence or better on both the original in- 
vestigation and the replication study are listed 
in Table 1. 

The possibility that the diagnostic groups 
were contaminated by the use of the Rorschach 
in their diagnosis is a justifiable criticism and 
can be answered finally only by further re- 
search. A strong case can be made for the 
assumption that the clinical use of the Ror- 
schach is not influenced to a major degree by 
the six items in the specific positive results. 


Table 2 
Schizophrenic Signs 


Average Form-Level Rating < 0.84 
Average Form-Level Rating (noncolor) < 0.93 
R + percent < 82 

Perseveration Present 
Confabulation Present 
Pathological Verbalization* Present 


*As defined in this study, an element which includes 
comments and responses that appear queer and peculiar, 
bizarre, incoherent and vague, illogical and absurd, crit- 
ical or aggressive, self-depreciatory, irrelevant, morbid to 
an excessive degree, or neologistic. 


While Contamination and Position did not 
show significant group differences on the origi- 
nal investigation but did so on the replication 
study, their comparative frequencies suggest 
that the presence of either type of response is 
practically pathognomonic for schizophrenia. 

The six statistically significant elements 
tabulated in Table 1 were converted into the 
“schizophrenic signs” listed in Table 2 by 
means of cut-off points at the inspectional 
median in the case of the first three listed, 
while presence alone was considered a sign in 
the case of the last three listed. The total 


Table 3 


Distribution of Schizophrenic Signs Shown by 
Subjects in Each Nosological Group 


Total signs per 


subject Neurotic Schizophrenic 

6 0 3 
5 1 15 
4 10 18 
3 s 29 
2 11 
1. 23 13 
0 40 11 

N= 100 N=100 


number of these signs for each of the individ- 
ual schizophrenic and neurotic cases used in 
both studies was determined. These results 
are presented in Table 3. By means of chi 
square, it was determined that ambulatory 
schizophrenics reveal a higher number of these 
six diagnostic signs, statistically significant at 
the .001 level of confidence, than do neurotics. 
If the presence of any three of these six diag- 
nostic signs were chosen arbitrarily as the cut- 
off point for a differential diagnosis between 
neurosis and schizophrenia on an individual 
basis, 65 per cent of the schizophrenics would 
have been identified properly. However, 29 
per cent of the neurotics would have been in- 
cluded falsely within the schizophrenic classi- 
fication. If five signs were selected as the cut- 
off point, a mere 1 per cent of the neurotics 
would have been categorized mistakenly but 
only 18 per cent of the schizophrenics would 
have been identified. Such results may have 
some value for group purposes but probably 
embody too much inaccuracy for individual 
differentiation. 


Summary and Conclusions 


1. Neurotics and ambulatory schizophrenics 
as groups do not show significant differences 
in the great majority of the Rorschach ele- 
ments treated. Finer tools within the element: 
themselves might prove more productive. a 

2. Five elements showed si , 
differences at the 5 per cent level of fi: 
dence on both samples. They are: Aeee a 
Form-Level Rating, Average tances 
Rating (noncolor), R+per cent Co fabula 
tion, and Pathological Verbalizäton T Per 


gnificant group 


` 
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severation has been retained as significant even 
though it*did not quite meet the above-men- 
tioned standard on one of the two samples. 

3. This research indicates the value of a rep- 
lication study in testing Rorschach factors. 

4. A worth-while by-product of this study 
is the demonstration that two trained individ- 
uals working independently with identical 
scoring guides agree to a large extent in the 
scoring of Rorschach responses. 

5. Several observations may be made with 
respect to the theoretical meanings of the ele- 
ments showing significant differences between 
the two diagnostic groups. The neurotic 
groups have more capacity to perceive com- 
monly seen concepts and are better able to 
organize and elaborate accurately than the 
schizophrenic groups. The schizophrenic 
groups are more inclined to have difficulty in 
shifting their thought trends, to be unduly 
elaborative in an unrealistic manner, and to 
indulge in bizarre and illogical reasoning. 

6. Kendig’s “Principle of distortion of 
reality’ [8] as crucial in the diagnosis of 
schizophrenia has been at least partially sub- 
stantiated by the present study. These schizo- 
phrenic groups do tend to confabulate, to 
perseverate, to verbalize peculiarly, to perceive 
in an unusual fashion, and to be inaccurate in 
organizational and elaborative capacity more 
frequently than the neurotic groups. 

7. Diagnostic “schizophrenic signs” obtained 
from the statistically significant elements may 
be useful for group differential purposes but 
are probably too inaccurate for individual 
diagnostic discrimination. It may be that these 
two groups are too ill defined as diagnostic 
categories to offer hope of a clear-cut differ- 
entiation between them by means of Rorschach 
signs. 

8. Although the results of this study are 
predominantly negative, one observation should 
be made. Since the two nosological groups 
employed overlap in symptomatology, results 
which are only moderately positive or indica- 
tive of a trend are actually more significant 
than are apparently better results with more 
divergent groups. 

9. It is highly improbable that the positive 
results obtained can be adequately explained 
by the posibility that the criterion groups may 
have beer! contaminated by the utilization of 


the Rorschach in their diagnosis. However, 
additional research is needed to verify this con- 
tention. 


10. The comparative efficiency of this Ror- 
schach sign technique and the global approach 
in the diagnostic differentiation of these two 
nosological groups might be worthy of study. 


Received June 13, 1952. 
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Productivity on the Rorschach as a Function 
of Order of Presentation’ 


Louis Joseph Maradie 


Increased productivity in the all-color cards 
(Figs. VIII, IX, X) is expected on the theory 
that color has a stimulating effect upon affec- 
tively labile individuals. Rorschach himself 
believed that there was a relationship between 
the number of responses influenced by color 
and the extent of emotional excitement al- 
though he states, “The causes of this corre- 
lation remain to be discovered” [8, p. 98]. 

A study reported by Dubrovner [4] in 
which he compared the effects of standard 
versus achromatic plates revealed no signifi- 
cant shifts in productivity upon retesting. The 
“color cards” (Figs. VIII-X) produced more 
responses than the “noncolor cards’ (Figs. 
I-VII) regardless of the presence or absence 
of color. In view of this it becomes tenuous 
to assume that color alone is responsible for 
increased productivity in the last three cards, 

In order to provide for controlled compari- 
sons, retesting of the same subjects under 
different conditions has been deemed necessa- 
ry. Rabin and Sanderson [7] retested their 
subjects with both standard and reversed 
orders of presentation and upon retesting 
found an increase in stereotypy (4%), reduc- 
tion of productivity in the reverse order con- 
dition, and a reduction of “shock” in the re- 
test irrespective of which order was first pre- 
sented. It appears that with the novelty of the 
Rorschach situation somewhat eliminated in 
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all but the first acquaintance with the test, 
comparisons between test and retest data 
are incongruous. 

Schachtel [9] believes that both reaction 
time and productivity are affected by the 
testee’s fears, attitudes, and interests which 
are activated by the testing situation. It seems 
that memory factors would strongly influence 
the subject's definition of the retest situation 
for the challenge of the now familiar and no 
longer enigmatic plates is dispelled. 


A common clinical observation is that the 
initial interview situation tends to be less pro- 
ductive than later ones. The subject finds 
himself in a novel relationship which, with 
the establishment of rapport, becomes decreas- 
ingly disturbing to him as a frame of refer- 
ence is gradually established. In the unstruc- 
tured Rorschach situation, the phenomenon 1S 
doubly significant. In empirically determining 
the order of the plates within the series, Ror- 
schach predicted that failure on the first plate 
would rarely be encountered [8, p. 16]. He 
realized that early-appearing hesitancy an 
evasiveness could be alleviated by a relatively 
simple introductory stimulus card. Initial re- 
straint and anticipatory anxiety would dis- 
appear as adaptation to the task developed. 

In using the Jatin square, this present study 
is designed to circumvent the artifacts which 
arise by retesting the same subjects under dif- 

erent conditions, Its specific purpose is to in- 

Vestigate the possibility that irrespective of 
the sequential positions of the cards, later- 
appearing cards will produce more responses 
than earlier cards. At the same time, this de- 
sign permits an evaluation of the produc- 
tivity attributable to the cards themselves, in- 
dependent of their order of appearance. 
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Procedure 

From a female nurses training school, a 
group of 22 volunteers were obtained. Their 
ages ranged from 17 to 28 years with a mean 
chronological age of 20.2 years. Of the 22 
subjects tested, 2 were omitted because of ex- 
treme overproductivity of autistic quality. In 
such a study dealing with a limited number of 
subjects, variant scores offer a definite proced- 
ural problem. Dangers of bias in omitting data 
must be balanced with dangers of including 
discrepant data which would prevent later 
generalization to other defined and homo- 
geneous groups. Rorschach authorities have 
indicated that the response totals for normal 
subjects rarely exceed fifty [1, 6, 8]. The 
response totals for the two subjects excluded 
were 115 and 143 respectively — both con- 
siderably more than twice as large as the next 
highest score of 49 responses. 

In the latin-square design as used here, 
systematically randomized standard Rorschach 
plates were presented to each subject (5, 
p. 302]. Ten distinct sequential orders were 
arranged in which each card preceded and 
followed every other card just once [3]. This 
arrangement may be made more apparent by 
examination of Table 1 in which each card 
appears once in each column and once in each 
row. In this square, any systematic influence 
resulting from the positional or sequential 
effect of the color cards would thus tend to 
be minimized. 

To each of these discrete orders, a subject 
was randomly assigned and presented with the 
plates peculiar to that order. The same latin 
square was replicated by the random assign- 


ment of an additional subject to each of the 
ten orders of presentation. In this manner, 
twenty different subjects responded to ten 
dissimilar orders of presentation. 

The instructions to the subjects were those 
suggested by Beck [2, p. Jj. After having 
given two or more associations for a figure, 
any declaration by the subject that she was 
through with it was accepted. Encourage- 
ment took place when less than two responses 
per figure were obtained but was progressive- 


ly reduced until it was entirely discontinued 
after the fifth card. 


Results 


Before the data from the two separate 
latin squares were combined, they were tested 
for homogeneity of total variance by means 
of Bartlett’s test [5, p. 195]. The resulting 
chi-square value of .683 was not significant 
and offered no evidence against the hypothesis 
of random sampling from a common popula- 
tion. 


In comparing the data of the separate latin 
squares, homogeneity of variance was also es- 
tablished for the residual mean square and the 
sequential position mean square. The F values 
obtained were 1.04 and 1.16 respectively. 
which were not significant at the 5 per cent 
level. 

After combining the data from the separate 
latin squares it was further ascertained that 
differences in productivity between the se- 
quences or pairs of subjects responding to one 
particular order in the latin square were not 
significantly different. Examination of the 
agreement between the samples as shown in 


Table 1 
Latin-Square Design of the Order of Presentation of the Rorschach Plates 
Positions 
= ee eS ee E 
1 I u il Iv v VI VIL VII IX x 
2 I Vv vl vm x I ml ov VI Ix 
3 Il VI IX I IV VII x II Vv VIT 
4 IV VIII I vV IX Il VI X Ill VII 
5 y x IV IX Ill VIII Il VII I VI 
6 VI I VII Il VIII Il IX IV X y 
7 vi m X VI II IX v I VII 
8 vir V I x va IV I Ix Hi ay 
9 Ix wiv Tm I x mm a nn = 
10 x Ix vit VI VI v IV I I 
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Table 2 


Sums af Responses for Orders of Sequential 
Presentation (Note Table 1) 


der of 
E Sample 1 Sample 2 Total 
1 34 43 77 
2 18 29 47 
3 31 2 40 71 
4 33 22 55 
5 21 23 44 
6 24 26 50 
7 49 23 72 
8 25 27 52 
9 15 23 38 
10 21 37 58 
Table 3 


Analysis of Variance Results 


S. S. df M.S. F 


Independent 

obseryations: 

Order of 

presentation 76.32 9 8.48 1.20 (not sig.) 
Residual between 

individuals 

(error) 70.60 10 7.06 

Total between 

individuals 146.92 19 


Correlated 

observations: 

Cards 35.32 9 3.92 4.45** 
Positions 43.52 9 4.84 5.48** 


Residual from 

latin square 78.36 72 1,09 1.23 (not sig.) 
Residual within 

individuals 79.40 90 88 
Total within 


individuals 236.60 180 


Total 383.52 199 


**Significant at 1 per cent level. 


Table 2 and the insignificant F value of 1.20 
in Table 3 demonstrate this fact. 

Table 4 reveals that the productiveness of 
these 20 subjects is apparently greater in the 
later sequential positions. The mean number 
of responses in the first seven positions was 
51.1 while that of the last three positions was 
68.7. A t value calculated for the difference 
between these means was 4.00, which was 
significant.at the 1 per cent level. Testing the 
significance of the mean square for total re- 


sponses by positions against the residual mean 
square within individuals, it was found that 
the obtained value of F (5.48) was highly 
significant for 9 and 90 degrees of freedom 


(Table 3). 
Table 4 


Aggregate Sums of Responses by Positions 


Positions Responses Positions Responses 
1 52 6 48 
2 46 7 59 
3 51 8 63 
4 48 9 66 
5 54 10 77 


The other factor of interest was the effect 
of the cards themselves. When tested for sig- 
nificance against the residual mean square, the 
mean square for cards was also found to be 
highly significant with an F value of 4.45 
(Table 3). 

Further analysis of the effect of color upon 
productivity demonstrated that when the 
number of responses of the color cards (Fig. 
II, I1, VIII, IX, X) was compared to those 
of the completely achromatic cards (Fig. L 
IV, V, VI, VII), the difference between the 
means (¢= 1.80) was not significant. When 
the number of responses to Figures I-VII was 
compared to those to figures VIII-X, the 
difference between the means was significant 
(*= 2.12) at the 5 per cent level. Examina- 
tion of Table 5 shows that Card X, in con- 
trast to Cards VIII and IX, is by far the 
Most provocative of the series. Since Cards 
VIII and IX are also completely chromatic 


Table 5 


gregate Sums of Responses by Cards 
in All Possible Positions 


Ag 


Cards Responses Cards Responses 
I 47 VI 57 
I 55 VII 58 
Ill 55 VIII 53 
IV 53 IX 59 
4 48 x 79 


and did not elicit any noticeable increment 
in productivity, it appears that the configura- 
tion of Card X may be the crucial factor facil- 
itating the subjects’ responsiveness. 
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Summary and Conclusions 

The data used in this experiment were ob- 
tained from 20 of 22 Rorschach-naive student 
nurses. The 2 subjects were discarded because 
of their extreme overproductivity. The 20 
subjects were presented with ten distinct 
systematically randomized sequential orders 
of standard Rorschach plates in a latin-square 
design. In this manner each plate appeared 
in all positions and preceded and followed 
every other plate an equal number of times. 
Within the limitations imposed by the homo- 
geneity of the sample used, examination and 
statistical analysis of the data revealed that: 


1. Irrespective of the order of the cards, the 
position of the cards is of importance with 
later-appearing cards producing more re- 
sponses than earlier-appearing cards. 

2. Irrespective of their orders of presenta- 
tion or their sequential relationships, the cards 
themselves differ in the number of responses 
clicited with Card X, because of its color or 
configuration, or both, evoking more responses 
than any other. 

Thus, it is shown that the positional effect, 
quite apart from color, could account for in- 
creased productivity in later-appearing cards. 
While made suspect, it is not definitely shown 
that color does not also have some effect. The 
present writer expects to isolate this factor by 
the presentation of achromatic plates in the 


same latin-square design. If similar results are 
obtained in this follow-up study, it will pro- 
vide conclusive evidence that the configuration 
of the plates and the order of their presenta- 
tion are the factors responsible for increased 
productivity in the later-appearing cards. 


Received July 30, 1953. 
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Rorschach Characteristics of Persons Scoring 
High and Low in Acceptance of Self 


Robert E. Bills 


University of Kentucky 


‘A technique called “An Index of Adjust- 
ment and Values” which is designed to give 
measures of the concept of self, acceptance of 
self, the concept of the ideal self, and malad- 
justment has been reported by Bills, Vance, 
and McLean [2]. Additional studies by Rob- 
erts [6] and Bills [3] have confirmed fur- 
ther the reliability and validity of the Index 
scores. 

The present study is concerned with one 
of the four measures of the Index—acceptance 
of self. Studies by Seeman [8], Snyder [10], 
Sheerer [9], and Stock [11], have established 
that during successful psychotherapy there is 
an increase in positive attitude toward self or 
acceptance of self. Since acceptance of self has 
been considered a central personality variable, 
it follows that people who are high in accept- 
ance of self should differ, in general, in their 
personality characteristics from people who are 
low in acceptance of self. 

The Rorschach test [1, 4, 7] purports to 
give a description of an individual’s person- 
ality. If persons who are high in acceptance of 
self differ in personality characteristics from 
people who are low in acceptance of self, and 
if the Rorschach is able to differentiate per- 
sonality characteristics, then persons who are 
high in acceptance of self should have Ror- 
schach test results which differentiate them 


as a group from persons who are low in ac- 
ceptance of self. 


Design 


Twenty volunteers, female students at the 
University of Kentucky, were tested with the 
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Index of Adjustment and Values and the Ror- 
schach test. This pilot group was divided into 
two groups on the basis of acceptance-of-self 
scores above and below the mean score of the 
group on which the Index was standardized. 
The division placed 15 subjects who had scores 
below the mean of acceptance of self in one 
group and 5 subjects who had scores above 
the mean of acceptance of self in the other 
group. A comparison of the Rorschach re- 


sults for the two groups suggested the hypoth- 
eses listed in Table 1. 


A second group of 50 volunteer students 
was obtained by using as the criterion of se 
lection, scores on acceptance of self as meas- 
ured by the Index of Adjustment and Values. 
Twenty-five of the subjects had scores which 
were in excess of one standard deviation above 
the mean acceptance-of-self score of the stand- 
ardization population of the Index (this grouP 
will be referred to as the “high scorers”) and 
twenty-five of the subjects (“low scorers”) 
had scores more than one standard deviation 
below the mean acceptance-of-self score of the 
standardization population. The two groups 
were balanced for sex and Kentucky General 
Classification Test scores. Each group con 
sisted of 8 male and 17 female subjects, an 
a test of the significance of the difference be- 
tween the means of the scores of the two 
groups on the Kentucky General Classifica- 
tion Test gave a z of .750 which showed that 
at the .60 level the groups were not significant- 
ly different in general ability. The groups were 
not significantly different in respect to the 
number of responses on the Rorschach, as may 
be seen in Table 1. 

Each of the 50 experimental subjects was 
tested with the Rorschach, using Beck’s in- 
structions [1], by an examiner who had no 
knowledge of the hypotheses under investiga- 
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Table 1 


The Hypotheses of the Study and the 
Statistical Results 


Variable Hypothesis BoA r 
M :Sum C Above Sum C©œ>M 14.346 001 
Below M > Sum C 
F+% Above F4% lower 35.280 .001 
than below 
FC Above less FC 9.680  .01 
CF Above more CF 27.000 .001 
CF:FC Above CF>FC 38.782 001 
Below FC>CF 
Sequence Above fewer cards n.s. 
in sequence 
AJo No difference in n.s. 
two groups 
F% No difference n.s. 
R No difference n.s. 
Fc'* No difference 2.080 .20 
M Above less M 2.000 .20 
Maps, etc. Above more evasive 2.225 .20 
(evasion) 
A+H: Above <2} wholeto 3.125 08 
Ad+Hd 1 part. Below >24 
whole to 1 part. 
P Above more P 4.023 .05 


%R VIII-X % smaller in 8.013 .01 


above group 


RT Chromatic No difference n.s. 
RT Achromatic No difference n.s. 
RT Dif. Chr. Above greater 2.922 .10 
and Ach. difference 
W:M Above IV >2M 4.667 -05 
Below W <2M 
TIR Above react quicker 3.945  .05 
No. Turns Above fewer turns 2.885 -10 
No. Cards Above turn fewer 2.000 .20 
Turned cards 
M:FM FM>M in above 8.323 .01 
FM <M in below 

Defense} Above more defensive 2.885 #0 
H% No difference n.s. 
cik} No difference n.s. 
W% Above larger Wo n.s. 
Obj. No difference n.s. 
N No difference n.s. 
Fire,etc. No difference n.s. 
(aggression 

aD i Below more (H) n.s. 
Fml| Above more Fin n.3. 


*Includes FO’, 0’, and O'F. 

+Includes Fe, c, cF, k, KP, Fk, K, KF, and FE. 
tRatio of Fe + c + cF tok + kr + Fk + K + KF + FR, 
llIncludes Fm, m, and mF. 


tion. The Rorschachs were then scored by a 
second person, not the Rorschach examiner, 


who had no knowledge of the subjects’ classifi- 
cation on the Index of Adjustment and Val- 
ues. The scoring system used was a mixture 
of Beck [1], Klopfer and Kelley [4], and 
Krugman [5]. Beck’s system was used to score 
populars and location, and to determine form 
level. In the determination of F+% Beck’s 
tables were used to-determine form level, and 
F+ 6 was calculated from the formula: Good 
F divided by Rorschach F. Rorschach F is the 
total number of determinants minus the color 
and human movement responses. All other 
scoring was from Klopfer and Kelley except 
as noted at the bottom of Table 1. 

The records of two of the “high scorers” 
and two of the “low scorers” were selected at 
random and scored by two judges working 
independently of each other.? Neither of the 
judges was acquainted with the basis of selec- 
tion of the subjects nor the hypotheses being 
tested. Percentages of agreement between the 
Rorschach scorer and the two judges were 
calculated for each of the four cases for the 
location, determinant, content, and “popular” 
categories. The percentages ranged from 76 
to 100, and 23 of the 32 percentages were 90 
per cent or greater. . 


Results 


Table 1 presents the Rorschach variables 
investigated, the predicted direction of the 
differences of the high scorers and low scorers, 
and the chi squares and probabilities resulting 
from the calculations from double dichotomous 
tabulations. In these tabulations one dichot- 
omy was formed by the independent variable, 
acceptance of self, and the other dichotomy 
by the division indicated in the prediction, or 
where no definite prediction was made con- 
cerning the dividing point, at the median score 
of all 50 cases. 


Discussion 


The data show striking differences in the 
two experimental groups. Only two of the 
low scorers had F+%’s less than the median 
of all 50 cases, and only two of the high scor- 
ers had F+%’s greater than the median. It 
may be concluded, therefore, that the high 


2The author is appreciative of the assistance giv- 
en by O. S. McLean and R. C. Nichols, who set ved 
as the judges. 
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scorers and low scorers are distinctly different 
i F%. 

ji pean lh of eae movement responses 
was not significantly different in the bes 
groups, although the difference _approac r 
statistical significance. A comparison of the 
number of human movement responses with 
the weighted color sum, ‘however, shows an- 
other striking difference—the experience bal- 
ances of the two groups are reversed. Twenty- 
two of the high scorers showed the sum of 
the weighted color responses greater than the 
number of M and one case had M equal to 
the sum of the weighted color responses, 
whereas, 16 of the 25 low scorers had the num- 
ber of M greater than the sum of the weighted 
color responses. This finding leads to the con- 
clusion that the high scorers are extratensive in 


their experience balance while the low scorers 
are introversive. 


The high scorers and low scorers differed 
significantly in the type and number of color 
responses. The low scorers used fewer color 
responses but more “well-controlled” color 
represented by FC, whereas the high scorers 
used a greater number of color responses and 
more “poorly controlled” color represented by 
a predominance of CF and C responses. No 
“pure C” appeared in the records of the low 
scorers, but 14 of the 25 high scorers showed 
at least one pure C response, Furthermore, the 
high scorers showed an excess of CF over FC, 
and the low scorers an excess of FC over CF, 
Of the 25 high scorers, 24 had more CF 
FC responses, but 23 of the low scorers 
more FC than CF. It is c 
that if the type and number of color responses 
is representative of affective life, then the high 
scorers have a stronger and less well-controlled 
affect than the low scorers. 

Other variables including number of popu- 


rs, the percentage of responses on the last 
three cards, the W:M rati 


than 
had 


oncluded, therefore, 


la 


or better, that the 
fierent. 


It is apparent, therefore, that in respect to 


certain important personality characteristics 
the high and low scorers, as measured by the 
Rorschac 


, Constitute two distinctly different 
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personality groups. Thus, it is concluded ki 
the Index of Adjustment and Values is a e 

Pf i a id 
to separate groups with different personality 
characteristics. 


Summary 


On the basis of a pilot study, 34 specific 
hypotheses were formulated relative to Bar 
schach variables present in the personalities at 
persons high and low in acceptance of oF a 
revealed by the Index of Adjustment and Val- 
ues. Fifty new subjects with extreme accept- 
ance of self scores were examined with the 
Rorschach test. Of the 34 hypotheses 23 were 
confirmed, + were denied, and 7 remain in 
doubt. 

It was concluded that distinct Rorschach 
personality characteristics distinguish subjects 
who are high in acceptance of self from those 
who are low in acceptance of self. 


Received July 19, 1952. 
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Adjustment and the Discrepancy Between 
Self Concept and Inferred Self 


A. D. Calvin and Wayne H. Holtzman 


The University of Texas 


One of the most widely accepted beliefs 
among psychologists today is that discrepancy 
between the self concept and objective reality 
is a common feature of maladjustment. Such 
discrepancies are said to represent a lack of 
insight, and a major goal of psychotherapy is 
to help the individual reorganize his self con- 
cept so that it will correspond more adequate- 
ly with the self as viewed by others. Granted 
that in general the above statement may be 
true, it does not follow, without further ex- 
perimental verification, that the relationship 
between such discrepancies and severity of 
maladjustment is as simple and direct as is 
often assumed. The present study was under- 
taken to examine the nature of this relation- 
ship in several groups of college men. 


Description of the Study 


Population. The population consisted of 79 
male students, all the members of four fra- 
ternities, A, B, C, and D, who were residing 
in their respective fraternity houses at the 
time. Each subject was well acquainted with 
all the others in his group, having lived con- 
tinuously in the chapter house for at least five 
months. The number of men in fraternities 
A, B, C, and D was 23, 17, 20, and 19, 
respectively. Groups of this size are small 
enough to allow extensive individual inter- 
action and yet sufficiently large to permit 
adequate statistical analysis. 

Collection of the data. All of the subjects 
were first given the Minnesota Multiphasic 
Personality Inventory (MMPI) in group 
sessions. The standard instructions for ad- 
ministering the test were followed [3]. At 
the time of testing an appointment was made 
to see each subject individually in order to 
gather data concerning his self-evaluations 
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and his judgments of the other members in his 
group. 

At the beginning of the individual session, 
each subject was interviewed briefly concern- 
ing his personal history in order to establish 
rapport and gain certain background infor- 
mation. Following the interview the subject 
was presented with a set of small cards, each 
containing the name of one of his associates 
and a code number for recording purposes. He 
was then asked to rank all the members of his 
group, including himself, on seven personality 
traits. Having the individual rank himself as 
well as the rest of his group made possible the 
study of discrepancies between the self- and 
group-judgments of each individual. A des- 
cription of each personality trait was typed 
on a plain, white card to facilitate the rank- 


ing. The traits used, in the order of presenta- 
tion to the subject were: 


1. Leadership. Place the individual whom you 
think would be most desirable as a leader to repre- 
sent the group in campus affairs at the top; rank 
the others in order beneath. j 

2. Tolerance. The general disposition of an in- 
dividual to be fair and patient toward peopl: 
whose attitudes are opposed to his own. e 

3. Adjustment. Well adjusted, handles personal 
problems well, rarely shows signs of excessive Anon 
1 Feng oe — happy. 

$ rive. Drives himsel 7. : 
teak ue ites elf onward, always tries 

5. Tactfulness. Tactful, aware of the feelin 
of others, keen, shows good discretion subtle. = 
blunt, polished and well-mannered. , anc 

6. Gregariousness. Very gregarious, the “life- 
of-the-party” type, mixes well and seems t j 
being around people. SEIS 

7. Social Understanding. The needs moti 
tions, interest, and activities of the ean 
a group are numerous. Molded together, these di 
verse needs, ete give the group a conan (held. 
by-the-majority) set of goals, objectives, and pur- 
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the individual whom you 
think oe e i of—and works 
hardest to achieve—these common goals, objectives, 
and purposes. 

These particular traits were chosen because 
they had been used successfully in previous 
studies [5, 6] employing similar ranking 
methods. e 

The interview and ranking session was con- 
ducted in complete privacy and each subject 
was told that his judgments would be guarded 
in strict confidence from the rest of the 
group. The subjects were informed that op- 
portunities to discuss their own MMPI scores 
would be available at the conclusion of the 
study, an arrangement which served to keep 
their motivational level high throughout the 
study. 

Method of analysis. Pooled rank scores for 
each individual on every trait were computed 
separately for each group by summing the in- 

dividual ranks assigned him by his associates 
and placing subjects in rank order according 
to their pooled scores. An individual’s final 
rank on a given trait thus represented the 
consensus of opinion of his associates, provid- 
ing an appropriate measure of one aspect of 
the inferred self, the individual “as an in- 
formed other person sees him” [4, p. 381]. 
Similarly, the rank which the subject assigned 
to himself on that same trait provided a cor- 
responding measure of one aspect of the self 
concept, “those parts of the phenomenal field 
which the individual had differentiated as de- 
finite and fairly stable characteristics of him- 
self” I8 p 112]; 

The trait description for the self-enhancing 
or more desirable extreme of each trait con- 
tinuum had been deliberately chosen for use in 
this study, so that self rank which was higher 
than the group rank for a particular individ- 
ual would be indicative of a self-enhancing 
discrepancy. On the other hand, a self rank 
which was lower than the group rank would 


indicate a self-depreciative discrepancy. 


_At first glance it would appear that a 
simple discrepan 


cy score could be obtained 
merely by subtracting the self rank from the 
group rank. There are two reasons why such 
a method is unsatisfactory. First, rank scores 
have a rectangular distribution while the dis- 
tribution of the underlying trait is more like- 


ly to be roughly normal. A discrepancy of, 
say, three ranks between self and group scores 
at cither extreme of the rank order will repre- 
sent quite a different psychological distance on 
the underlying trait continuum than the same 
numerical discrepancy in the middle range. 
Second, the direction and size of such a dis- 
crepancy score is partly a function of the 
group rank. For example, an individual who 
is judged by his associates to be the best ad- 
justed person in his group can only receive a 
self-depreciative discrepancy score while the 
most maladjusted individual can only get a 
self-enhancing score. To the extent that the 
group rank and discrepancy score are corre- 
lated, any conclusion based upon an analysis 
of such simple discrepancy scores would be an 
artifact. 

The first of these difficulties was largely 
overcome by assuming that the underlying 
trait distribution was normal.’ ‘Tables were 
constructed for each group for converting 
ranks into scale values on the baseline of the 
normal distribution curve so that each of the 
resultant distributions had a mean of 5.0 and 
a standard deviation of 2.0 [2, p. 248]. A 
discrepancy score, (G—S), was computed for 
every individual on each trait by subtracting 
his converted self-score, S, from his converted 
group score, G. 

To eliminate the spurious relationship be- 
tween G and (G—S), the effect of G was 
partialled out in the following manner: A 
Scattergram was constructed for each of the 
Seven traits by plotting G against (G— S), 
using all 79 individuals. Since in every case 
visual inspection of the scattergram showed 
Clearly that the regression line for predicting 
(G~8) from G was linear with homoscedastic 
arrays, product-moment correlation coefficients 
and regression equations for predicting 
(G~8) from G were computed. As might be 
anticipated from the earlier discussion, the 
correlations (presented in Table 1) were 
sufficiently high in every case to require ad- 
_ 1The validit 
instance is bor 


subject would 
ficulty rankin 


y of this assumption in the present 
ne out by the fact that invariably the 
claim that he had considerable dif- 
g individuals in the middle ranges, 
but that as he moved toward either extreme the 
task became much easier, indicating that the un- 


derlying psychological continuum was bell shaped, 
probably normal, 
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. 
justment of the self-group discrepancy scores. 
Regression equations were plotted on each 
scattergram and corrected discrepancy scores 
were determined by the following equation: 
(G—-S).= (G—S) — (G—S)* 
where 
(G—S).=corrected discrepancy score 
(G—S) = original discrepancy score 
(G—S)*=discrepancy score predicted 
from regression of (G—S) on 


G. 


Table 1 


Correlation Between G and (G—S) for Each of 
the Seven Traits 


Trait r 
Leadership 71 
‘Tolerance 68 
Adjustment 79 
Drive 59 
Tactfulness 73 
Gregariousness 63 
Social Understanding 68 


The corrected discrepancy score, (G—S) cy 
is that part of the original discrepancy between 
self- and group-judgment for a particular trait 
and individual which remains after the spur- 
ious relationship between G and (G—S) has 
been eliminated. A positive (G—S)ec can be 
thought of as indicating a self-enhancing tend- 
ency greater than the average individual with 
a comparable G score, the larger (G—S). the 
stronger the relative amount of self-en- 
hancement. Similarly, a negative (G—S). can 
be interpreted as indicative of less than aver- 
age self-enhancement or even self-depreciation, 
as the case may be. 

Four measures of the discrepancy between 
self concept and inferred self were derived for 
comparison with adjustment as measured by 
the MMPI. The first consisted of (G—S). 
for the trait Adjustment. The second was a 
more general measure of self-enhancing tend- 
ency obtained by summing algebraically 
(G—S), across the seven traits for each indi- 
vidual. This will be referred to as Sum 
(G—S).. The third and fourth scores, 
\(G—S),| for Adjustment and Sum 
|(G — §).-|, were similar to the first two 


with the exception that the direction of the 
discrepancy was ignored in each case. In a 
sense they are measures of insight defined 
simply as the degree of agreement between the 
inferred self and the self concept. 


Results 


Before attempting to study the relation- 
ships between variables derived from the 
group- and self-judgments and scores on the 
MMPI, the reliabilities of these new vari- 
ables should be examined. The reliability of 
G, the pooled group score assigned each in- 
dividual, has been reported by Greenwood [1] 
in an unpublished study using these same data. 
Reliability coefficients were computed sepa- 
rately for each of the four groups of subjects 
by dividing each group into two halves and 
correlating the pooled scores. As estimated by 
the Spearman-Brown formula the reliabilities 
of the final pooled scores varied from .85 for 
Tolerance to .94 for Leadership, highly satis- 
factory for the present purposes. 

Although the present data permit no evalu- 
ation of the reliability of S, the self-judgment, 
evidence is available from an earlier study on 
a similar group of subjects that the reli- 
ability of self-judgments is also quite high. 
From data provided by Ogdon [6] in a 
longitudinal study of 21 men in a fraternity 
at the University of Texas, the present 
authors obtained high test-retest reliability for 
self-judgments of leadership. The correlation 
between scaled ranks over a three-week period 
was .97. After six weeks during which the 
fraternity elected new officers, calling for 
sharp changes in the self concepts of several 
individuals, the test-retest reliability was .90. 
This suggests that self-judgments obtained by 
the present methods have a high degree of re- 
liability over a time span of at least several 
weeks. 

Since both G and S are presumably highly 
reliable, it follows immediately that (G—S), 
and |(G—S )e| also have sufficient reliability 
to warrant serious investigation of their re- 
lationships to independent measures of per- 
sonality. 

To have clear meaning as a derived variable, 
Sum (G—S), should reflect a consistent tend- 
ency for an individual to enhance or depreciate 
himself, relatively speaking. on a variety of 
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personality characteristics. The degree = such 
self-consistency was determined by correlating 
the sums of (G—S)¢ for traits 1, 2, and 7 
with the sums of (G—S), for traits 3, 5, and 
6. The choice of these particular traits was 
based upon a cluster analysis of the trait inter- 
correlations [1] and represents an attempt to 
make the two sets of scores as comparable as 
possible. The situation is somewhat analogous 
to that frequently encountered in test theory 
where over-all test reliability is estimated from 
the correlation between two similar halves, 
although in the present case the halves are 
only roughly parallel at best. The correlation 
between the two sets of scores was only .35, 
a low value but one which is significantly dif- 
ferent from zero. A crude estimate of the reli- 
ability of Sum (G—S), obtained by the Spear- 
man-Brown formula is .56. The low degree 
of consistency in the discrepancies between 
self- and group-judgments from one trait to 
another may be due in large part to consider- 
able variability in the extent to which posses- 
sion of a given Personality characteristic pro- 
vides self-esteem. 

In a similar manner, the split-half correla- 
tion for Sum |(G — S) | was determined and 
found to be only .19, too low to justify further 
analysis of this variable, Moreover, the dis- 
tribution of Sum \(G-S8).|, is somewhat 
U-shaped due to the summing of (G-S), 
without regard for algebraic sign, making 
comparison with other variables by correla- 
tional methods difficult to interpret. 


Table 2 
Correlations of MMP 


I Scales with Adjustment and 
Two Measures of 


Self-Enhancing Tendency 
G for (G—S) . for 


Adjustment Adjustment Sum (G—S) , 
Hs ll 


MMPI 
Scale 


—.17 —.02 
D 29% —.42** —.17 
Hy ha | —.03 —.10 
Pd -18 —.16 —.13 
Mf 33% —.14 02 
Pa .09 —16 .03 
Pt .34* =r = 
Sc 30* -ga —.13 
Ma 14 —.03 ll 


+r signifiec atly different from zero at .01 level 
**r significantly different from zero a* .001 level 


A. D. Calvin and Wayne H. Holtzman 


After first adjusting raw scores on the 
MMPI for K and then converting to T 
scores using tables given in the MMPI man- 
ual, product-moment correlation coeficients 
were computed between each of the standard 
MMPI scales and cach of three scores from 
the rank data: (a) (G—S),. for Adjustment, 
(b)Sum (G—S),, and (c) G for Adjustment. 
The group score for Adjustment was included 
because of interest in the relationship between 
adjustment as measured by a personality in- 
ventory and adjustment as judged by an in- 
dividual’s close associates. Table 2 summarizes 
the results of this analysis. 

The pattern of relationships between scores 
on the MMPI and G is somewhat similar to 
that for (G—S), in spite of the fact that G 
and (G—S),. have zero correlation as a result 
of the procedures used to derive (G—S)c. 
Sum (G—S),, on the other hand, is not sig- 
nificantly correlated with any of the MMPI 
scales. This is probably due primarily to the 
unusually low reliability of Sum (G—S). as 
a measure of self-enhancing tendency. 

To the extent that D, Pt, and Se are 
measures of maladjustment, the highly signifi- 
cant relationship between the MMPI and 
(G—S8).. for Adjustment indicates that tend- 
ency to enhance the self is inversely related to 
maladjustment, the more poorly adjusted the 
individual, the more self-depreciative, relative- 
ly speaking, he appears. This finding is in 
agreement with results obtained by Sheerer 
working in an entirely different context. In 
a study of counseling interviews she reported 

++-a marked and fairly regular increase in 
the measured acceptance of and respect for 
self from the beginning to the end of the 
case” [2, p 175]. In each of ten cases the 
occurrence of self-depreciative statements de- 
creased as the client’s adjustment improved 
during the course of counseling. 

he meaning of the relationship between G 
and the MMPI becomes clearer when the 
structure of the MMPI is examined more 
closely. In a factor analysis of 15 MMPI 
scales, Tyler obtained five factors, the first of 
which was defined chiefly by D, Pt, and Sc, 
the three scales significantly related to G and 
(G=8). in the present study. In interpreting 
this factor, Tyler states, “It appears... to 
reflect a chronic state of marginal maladjust- 
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ment duding concern with one’s self. Sub- 
jects who score high on the factor would tend 
to have difficulties in their social contacts, 
possibly by reason of their dissatisfactions, 
worry and disgruntlement, and their com- 
plaining and pessimistic attitude” [9, p. 454]. 
The significant relationship between G and 
the Mf Scale suggests that manifestation of 
a feminine interest pattern in a fraternity 
member is sometimes viewed by his associates 
as a sign of maladjustment. 

Using |(G—S).| as a measure of insight 
with respect to adjustment two groups of 
subjects were formed, a High Insight Group 
consisting of 24 individuals with |(G—S).| 
less than or equal to 0.5, and a Low Insight 
Group comprised of 14 men with |(G—S).¢| 
greater than or equal to 2.0. Mean T scores 
for these two groups on cach of the MMPI 
scales are presented in Table 3, together with 
t values reflecting the significance of the group 
differences. 


Table 3 
Comparison of High Insight Group and Low 
Insight Group on the MMPI 


MMPI 


Mean T Score 

Scale Low Gp. High Gp. t p 
Hs 56.1 49.2 2.32 .05 
D 55.6 54.6 0.22 —= 
Hy 58.0 55.7 1.13 
Pd 60.2 52.0 2.72 
Mf 66.5 60.7 2.30 05 
Pa 55.6 52.8 1,15 
Pt 60.2 57.1 0.84 — 
Se 61.0 56.0 1.48 — 
Ma 59.3 56.6 0.78 — 


The mean of the Low Insight Group is con- 
sistently higher than that of the High Insight 
Group, sufficiently so for scores in three of 
the MMPI scales to prove significantly dif- 
ferent. This result indicates that individuals 
who manifest poor insight regarding their own 
level of adjustment are more likely to be 
maladjusted than are those who show good 
insight, substantiating the claim which is fre- 
quently made that lack of insight is a sign of 
maladjustment. 

The highly significant difference between 
the two groups on the Pd Scale is of particular 
interest. Although the MMPI scale desig- 


nations must not be taken too literally, the 
frequent interpretation of a high Pd, score as 
indicating an inability to profit from experi- 
ence, a tendency to disregard social mores, and 
a general lack of insight [3] is entirely con- 
sistent with the results of this study. 


Summary aad Conclusions 


All resident members of four fraternities 
were administered the Minnesota Multiphas- 
ic Personality Inventory. In later individual 
sessions each individual ranked all the mem- 
bers of his fraternity, including himself, on 
seven personality traits, Leadership, Toler- 
ance, Adjustment, Drive, Tactfulness, Gre- 
gariousness, and Social Understanding. A 
normalized pooled rank score (G) for each 
individual on every trait provided an appro- 
priate measure of one aspect of the inferred 
self. The respective self-rank (8) provided a 
corresponding measure of one aspect of the 
self concept. Adjusted self-group discrepancy 
scores, (G—S)e were used to derive four 
measures of the discrepancy between self con- 
cept and inferred self: (a) (G—S). for 
Adjustment, (b) Sum (G-S8)., (c) 
\(G—-S).| for Adjustment, and (d) Sum 
|(G—S),|. The first two served as measures 
of self-enhancing tendency; the latter two as 
measures of insight. 

The major findings of this study are as 
follows: 

1. Corrected self-group discrepancy scores 
obtained by the present procedures are suffi- 
ciently stable to warrant serious consider- 
ation as new measures of personality. 

2. Tendency to enhance the self is inverse- 
ly related to maladjustment, the more poorly 
adjusted the individual, the more self-depreci- 
ative, relatively speaking, he appears. 

3. Maladjustment as judged within a re- 
stricted normal range by an individual’s as- 
sociates is directly related to maladjustment 
as measured by a typical personality inven- 
tory, the MMPI. 

4, Individuals who manifest poor insight 
regarding their own level of adjustment are 
more likely to be maladjusted than are those 
who show good insight. 
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Recent Research with Personality Inventories 


Albert Ellis 


New York, N. Y. a 


Although it is often assumed that projective 
techniques of personality evaluation have vir- 
tually monopolized the field of clinical psy- 
chology in recent years, and that paper arid 
pencil tests of personality are rarely employed 
by reputable clinicians, the fact remains that 
far more research and theoretical papers on 
personality questionnaires have been published 
during the past six years than have been 
published during any equivalent period in the 
history of psychology. Indeed, with the possi- 
ble exception of the Rorschach test, it would 
appear that more research and clinical use is 
now being made of personality inventories 
than of any other type of assessment instru- 
ment; and if educational, vocational, counsel- 
ing, and military applications are included, 
then it would appear that more children and 
adults are now being given personality ques- 
tionnaires than are being given any other type 
of diagnostic procedure or instrument. 


Several comprehensive reviews of the litera- 
ture on personality inventories have appeared 
during the past several years, including those 
by Anderson and Embree [1], Ellis [3, 6, 9], 
Ellis and Conrad [10], Eysenck [11], Strang 
[14, 15], Strang and Pansegrouw [16], 
Traxler [17, 18], and Traxler and Jacobs 
[19]. The present paper will not be another 
such review, but will briefly report the results 
of a study of the effectiveness of personality 
inventories when they are employed for various 
kinds of individual and group discriminations. 
In the course of this study, all research reports 
On personality questionnaires which appeared 
in the literature between January, 1946 and 
December, 1951 were surveyed. The results 
of these research reports were tabulated to 
determine whether, according to the criterion 
and level of significance stipulated by the 
author of each report, the inventory employed 
in each study did or did not significantly dis- 


criminate among the individuals or groups 
tested. 

: A survey of the recent studies of personality 
inventories reveals the following findings: 

1. In 21 studies where intercorrelations 
were calculated among the subscales of differ- 
ent inventories to determine whether they 
were significantly related to each other, 20 
studies showed significantly high correlations, 
indicating that the inventories were not meas- 
uring as many independent traits as their 
manuals claimed that they were. 


2. In 26 studies where scores on one per- 
sonality inventory were correlated with scores 
on another inventory purporting to measure 
equivalent traits, 12 correlations were found 
to be significantly high while 14 were not. 

3. In 12 studies where inventory scores 
were correlated with Rorschach test results, 
significant relationships were found in 2 in- 
stances but were not found in the other 10 
studies. Significant relationships between in- 
ventory scores and other projective technique 
results were found in 1 instance and not found 
in 3 other studies. 

4. In 25 studies where the ability of sub- 
jects to fake personality inventory scores was 
tested, it was found that they could and did 
fake significantly better or worse scores in 22 
instances and that they did not do so in 3 in- 
stances. In several of the studies demonstrat- 
ing that personality inventory scores could be 
faked, it was found that special detection 
scales, such as the F minus K scale of the 
Minnesota Multiphasic Personality Inventory, 
could partially spot and compensate for the 
faking. 

5. Results of using personality inventories 
for making various types of group discrimi- 
nations are summarized in Table 1. In general, 
the data in Table 1 would indicate,that the 
inventories significantly differentiate most oft- 
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Table 1 


Significant Discriminations Found in Research Studies with Personality 
Inventories, 1946 to 1951 


Discriminations Tested 


Number 
of Studies 
in which 
Significant 
Discriminations 
Were Found 


Number 
of Studies 
in which no 
Significant 
Discriminations 
Were Found 


Total 
Number 
of 
Studies 


Inventory scores vs. diagnostic examinations: 
Neuropsychiatric conditions 
Psychosomatic conditions . 
Delinquent, criminal, and psychopathic behavior . 
Alcoholism 
Predicting success in treatment . 


Total 


Inventory scores vs. personality ratings, by associates, 
instructors, or counselors: 

Personality ratings . 

Sociometric ratings - 


Total 


Inventory scores ys. behavioral characteristics 
Extent of social participation 
Leadership success —......-.—.. 
Propensity to remain healthy . 
Success in courtship and marriage . 
Tendency to become a sexual deviant . 
Tendency to have a favorable self concept 
Extrasensory perception ability 
Success at motor tasks ....W......... 
Tendency to take pronounced attitudes on 

controversial questions 


Total —. 


Inventory scores ys. vocational and academic test and 
performance results: 
Tendency to have specific vocational interests 
Membership in different vocational groups .. 
Success in actual vocational performance 
Success in academic achievement 


atal seasea ap tie c 


Inventory scores vs. group differences: 
Intellectual groups 
Educational groups 
Age groups 
Sex Groups 
Socioeconomic groups . 
Ethnic groups 
Marriage and family groups 
Disabled and ill groups . 
College groups a 
Regional and national groups 
Religious groups .. 
Veterars groups . 
Miscellaneous groups 


Vota! =... 
Grand Total 
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R 
en when used with psychodiagnostic groups 
and least often when used with vocational and 
academic groups, with their discriminative effi- 
ciency when used with other kinds of criteria 
or groupings falling somewhere in between. 

At first blush, it is difficult to say whether 
the results of these recent researches with per- 
sonality inventories are disappointing or not. 
On the one hand, they would seem to indicate 
that the inventories give reasonably successful 
discriminations when used with neuropsychi- 
atric, psychosomatic, alcoholic, age, sex, ethnic 
and college groups. On the other hand, they 
would seem to indicate that the inventories are 
not measuring the independent traits they are 
supposed to measure; that they do not agree 
too well with each other nor with the results 
of Rorschach and projective tests; that they 
are easily faked; and that they discriminate 
unsuccessfully when used with vocational, aca- 
demic , socioeconomic, and disabled and ill 
groups. Above all, these results would indicate 
that, in virtually none of the areas in which 
they are commonly used, do personality ques- 
tionnaires consistently show significant group 
discriminations. On the contrary, different ex- 
perimenters keep obtaining directly contradic- 
tory results when using the same or similar in- 
ventories. 

Actually, the results shown by this survey 
are less favorable for personality inventories 
than cursory examination would indicate. De- 
tailed analysis of many of the studies surveyed 
shows the same methodological failings that 
Ellis and Conrad [10] pointed out in a previ- 
ous review. That is to say, many of the studies 
in which significant discriminations were ob- 
tained are suspect because they involved criter- 
ion contamination or overlap, inadequate or 
overly diffuse samples, set-up experiments, dif- 
ferential motivation on the part of the sub- 
jects, and statistical and other shortcomings. 
Moreover, since personality inventories are 
Normally designed for individual diagnosis or 
assessment, since most of the surveyed studies 
are of group discriminations, and since these 
group results are rarely consistently discrimi- 
native, it is clear that the validity of these in- 
struments for the main specific purpose for 
which most of them have been designed is, 
as yet, far from being solidly established. 


Perhaps the main failing in many of the 


studies surveyed is the tendency of many 
authors to assume that, merely because signifi- 
cant score differences have or have not been 
found, significant trait differences have or have 
not been proved. One researcher after another 
keeps concluding that “members of the unac- 
cepted group are more likely to have per- 
sonality disturbances than members of the ac- 
cepted group” [2]; or “a significant relation- 
ship was found to exist between one’s person- 
ality adjustment and his occupational inter- 
ests” [12]; or the like. Such conclusions, of 
course, will not be warranted until it is con- 
clusively shown, beyond a shadow of a doubt, 
that personality scores do have a consistently 
high relationship with ‘personality disturb- 
ance,” “personality adjustment,” ‘“neurotic- 
ism,” or other traits which their authors and 
publishers claim they have. 

The results of the present study, as well as 
of previous surveys made by the writer [4, 5, 
6, 7, 8, 9, 10], would lead to the conclusion 
that although modern personality inventories, 
when employed for group diagnosis, have some 
degree of validity, scores obtained by individ- 
ual subjects are partly or largely dependent 
upon (a) the subject’s specific motivation at 
the time of taking the test; (4) the conditions 
under which he is tested; (c) his intelligence; 
(d) his degree of psychological sophistication ; 
(e) his general test-taking attitudes; (f) his 
general psychological defenses; (g) his specific 
(conscious and unconscious) tendencies to lie 
to others and to himself; and (/) various other 
motivational and attitudinal factors. To con- 
sider these factors adequately, a good many 
“correction” scales or devices must be included 
in modern inventories—such as the various 
correction scales which have been and still are 
being added to the MMPI. So far, however, 
such correction scales have been shown to have 
only a limited effectiveness ; and it may be that 
some of the most needed of these scales—e.g., 
one which would indicate the extent to which 
subjects unconsciously defend themselves 
against answering inventory questions in an 
objective manner—are almost impossible to 
devise, validate, and effectively incorporate in- 
to testing procedure because of the intrinsic 
limitations of personality questionnaires, 

When suitable correction and qualitative 
analytic procedures are devised for use with 
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inventories, they normally add enormously to 
the scoring and interpretation time of the _—_ 
Thus, utilizing a test like the MMPI today 
involves scoring the correction as well as the 
clinical scales, interpreting all the scales 
globally in terms of the correction factors and 
in relation to all the other scales, and doing 
a profile analysis rather than simple score in- 
terpretations. P 
The question therefore arises: Assuming 
that the newer scoring and interpretation tech- 
niques give a more valid picture of the sub- 
ject’s “personality” than do the older methods 
(an assumption which has not as yet been ex- 
perimentally validated), are they worth the 
time and effort involved? After all, personality 
inventories were originally devised not because 
no other or better methods of assessing certain 
human “traits” were known during the First 
World War (when the Woodworth Personal 
Data Sheet became the first of a long line of 
such instruments), but because they presuma- 
bly offered a quicker and more convenient 
method of “personality” assessment than did 
conventional psychiatric interviews and other 
diagnostic techniques. If, now, as is evident 
from the material in Hathaway and Meehl’s 
monumental MMPI Aflas [13], the average 
clinical psychologist must take considerable 
time and trouble to master the technique of 
scoring and interpreting inventory results, and 
then must spend an hour or two scoring, graph- 
ing, and interpreting the results of each in- 
dividual test given, the vaunted “advantages” 
of using inventories become most dubious. 
Otherwise stated: since personality inven- 
tories depend, in the last analysis, on printed 
questions, and since virtually no one claims 
for them the advantage of getting at uncon- 
scious and semiconscious material which effect- 
ive clinical use of interview and projective 
methods are generally conceded to some extent 
to uncover, it is difficult to see why clinicians 
should spend considerable time first mastering 
and then using these inventories. The clinical 
psychologist who cannot, in the time it now 
takes a trained worker to administer, score, 
and interpret a test like the MMPI according 
to the best recommendations of its authors, get 
much more pertinent, incisive, and depth- 
centered.. personality” material from a 
straightiorward interview technique would 


hardly appear to be worth his salt. 


Summary 


A study was made of all researches on per- 
sonality inventories published between Jan- 
uary, 1946 and December, 1951. It was found 
that in most cases inventory scores discriminate 
significantly when used with neuropsychiatric, 
psychosomatic, alcoholic, age, sex, ethnic, and 
college groups. On the other hand, it was 
found that in most instances the inventories 
are not measuring the independent traits they 
are supposed to be measuring; they do not 
agree too well with each other nor with the 
results of Rorschach and projective tests ; they 
are easily faked; and they usually do not give 
significant group discriminations when used 
with vocational, academic, socioeconomic, and 
disabled and ill groups. It was especially found 
that, in none of the areas in which they are 
commonly employed, do personality inventories 
consistently show significant group discrimi- 
nations. It was pointed out that when these in- 
ventories are most effectively used, they tend to 
become equally as time consuming as alterna- 
tive psychodiagnostic procedures, such as inter- 
viewing and the use of projective techniques, 


that seem to be more clinically incisive and 
valuable. 
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On the basis of clinical observations and ex- 
perimental evidence schizophrenic thought pro- 
cesses have been described as being rigid, 
concrete, and distorted. However, experimen- 
tal studies in this area have not provided con- 
sistent support for most of these generaliza- 
tions. The purpose of this research was to 
investigate distortion in schizophrenia using a 
controlled quantifiable approach. 

In reference to schizophrenic behavior, what 
might be called distortion has been described 
in many ways, ranging from Beck’s [3] “in- 
accurate perception” of clearly implied forms 
to Cameron’s [4] “displacement” of precise 
verbal terms by approximate concepts. In 
Aborn’s review of the literature, he concluded 
that although “it may be regarded as secondary 
to some more fundamental notion of abnor- 
mality, distortion is in its broadest sense pri- 
marily descriptive of the introduction of con- 
tradictory elements into a situation Providing 
no external barriers to consistent behavior” 


D p: 7]. 
Methodology 


The methodology employed in this research 
stems from the work of Asch [2], Goodman 
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person was formed. From the responses of his 
subjects to a checklist of trait names, he found 
that an impression of personality is a function 
of an interaction of traits rather than of 
simple summation. A variation of this proce- 
dure was developed by Goodman and Lorge 
and utilized in a study of the dynamics in- 
volved in the formation of personality im- 
pressions by seventh- and ninth-grade school 
children. Aborn modified the technique as it is 
used in the present research. 

Studying distortion in schizophrenia, the 
latter investigator constructed a number of 
short stories describing hypothetical people. 
Some of the stories utilized positive trait ad- 
jectives only, and some contained only nega- 
tive traits, Further, one set of descriptive 
Stories explicitly stated trait names, while 
another simply implied them. For example, the 
all-positive story with trait names explicitly 
Stated was as follows: 


The first things people notice about him are that 
he is cheerful and friendly. In school, he always 
Bot good marks and was looked upon as being in- 
telligent. He is very active and takes part in all 
Sports. As a player, he is known to be fearless and 
is respected because he is honest. 


In Comparison, the all-positive story with 
the traits implied was: 


On his way home, he found a pocketbook in the 
Street and turned it over to the policeman on the 
corner. He smiled and greeted most of the people 
he passed along the street and stopped to talk with 
the man at the newspaper stand. The newspaper 
man likes to listen to him because he usually knows 
what is going on in the world. Sometimes they talk 
about baseball, since they both play on the neigh- 
borhood team, They have known each other ever 
since he chased and caught two men who ha 
robbed the newspaper stand. 
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Immediately after reading each story, the 
subject indicated his “picture” of the person 
in the story by checking appropriate words on 
a word-selection checklist, which consisted of 
36 positive and 36 negative adjectives. The 
checklist was constructed to sample all areas of 
personality description, with the affective tone 
of the adjectives being based on the ratings of 
62 judges. For each story, the subject’s 
responses could be quantified in terms of re- 
turn of givens, expansions, and distortions. A 
distortion was operationally defined as a 
response which was inconsistent with the given 
trait pattern of a story; for example, checking 
a negative adjective for a positive story.’ 

While Aborn’s results failed to show any 
statistically significant differences between a 
mixed group of schizophrenics and normals, 
a trend toward greater distortion on the part 
of the experimental group was noted. It seemed 
possible that this trend might be accentuated 
if more opportunity were allowed for the 
schizophrenics to introject the stimulus materi- 
al by inserting a time interval between the pre- 
sentation of the stories and the checklist. 


Experimental Procedure and Subjects 


In testing this hypothesis, the following two 
modifications in methodology were employed: 
(a) the experimental group was confined to 
Paranoid schizophrenics; and (b) a temporal 
factor was introduced. After reading each 
Story, the subject spent five minutes on a 
simple motor task in which he was required to 
Cross out O’s and circle X’s. Then he was pre- 
Sented with the checklist and asked to check all 
the words he would use to describe the person 
in the story. This procedure was followed for 
all four stories. The stories were presented in a 

ifferent order to different subjects to mini- 
mize any transfer effects that might be in- 
Volved, 

The Paranoid schizophrenic and normal 
8roups both contained 27 male subjects. The 
groups were equated for age, education, and 
wtelligence, as shown in Table 1. The sub- 
Jects were selected from a rather limited age 
Tange; it actually extended from about 22 to 
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ol For a more detailed account of Aborn’s method- 
Ogy, a microfilm of his complete manuscript can 
€ obtained from University Microfilms, Ann Ar- 
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35 years. The measure of intelligence was a 
short form of the Wechsler-Bellevueé Scale, 
Form 1 (consisting of the Comprehension, 
Arithmetic, and Similarities subtests), which 
Rabin [6] and others have shown correlates 
very highly with the full scale with both nor- 
mals and neuropsychiatric Patients. In order 
to reduce the possibility that some of the words 
in the stories or checklist might be misunder- 
stood by the subjects and thus contaminate the 
results, the minimum IQ established for the 
selection of subjects was 100. Further, since 
none of the words in the stories and checklist 
were, according to the Thorndike-Lorge word 
count [7], above seventh-grade comprehension 
(an educational level below all the subjects), 
this was deemed an adequate safeguard. An 
attempt was also made to select the two groups 
so there would be an equivalent range of oc- 
cupations. 


Table 1 
Group Characteristics of the Paranoid Schizo- 
phrenics (N = 27) and the 
Normals (N = 27) 


Intelligence 


Group Age Education IQ 
Mean SD Mean SD Mean SD 
Normals 29.6 40 123 25 115.8 10.0 
Schizo- 
phrenics 30.6 3.9 12.0 2.6 116.1 12.2 


The subjects of the experimental group had 
all been given a final diagnosis of “schizo- 
phrenia, paranoid type” by a staff of hospital 
psychiatrists. The majority were open-ward 
patients, and all were cooperative and in good 
contact. All the normals were gainfully em- 
ployed, had never been hospitalized for neuro- 
psychiatric reasons, and were not currently 
undergoing treatment. 


Results 


A comparison of the two groups on the total 
number of adjectives used for each story, 
summarized in Table 2, reveals no differences. 
None of the computed ż ratios are above 1.00. 
The data were then analyzed on the basis of 
return of givens for each story, which refers 
to the checking of trait adjectives stated direct- 
ly or strongly implied in the stories. As can be 
seen in Table 3, there was a tendency for the 
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Table 2 
i Comparison of the Experimental and Control Groups 
on the Total Number of Adjectives Used —— 
Total Number of Adjectives Checked 
Stories® 
Grou 
j 1-A 2-A 1-B 2-B 
Mean SD Mean SD Mean SD Mean SD 
Norma ssassn á 24.52 8.69 17.78 8.07 24.59 9.37 18.11 6.70 
Schizophrenics....---.-..-.-- 26.81 8.56 20.37 10.41 23.70 8.85 19.37 8.01 
*Key: 1, all positive traits; 2, all negative traits; A, traits stated directly; B, traits implied. 
Table 3 
Comparison of the Experimental and Control Groups 
on Return of the Givens 
Return of Givens 
Group Stories 
1-A 2-A 1-B 2-B ' 
Mean SD Mean SD Mean SD Mean SD 
Normals... 5.33 0.94 4.63 1.39 5.11 1.02 4.41 1.49 
Schizophrenics. 5.00 1.19 4.11 1.81 4.70 1.24 3.78 1.90 
25:15 OEREO m 1.14 1.18 1.29 1.33 


normals to return more givens and the schiz- 
ophrenics to be more variable. Neither trend, 
however, reaches statistical significance.* 


In analyzing the distortion scores, the chi 
square yielded by Bartlett’s test of homo- 
geneity showed that homogeneity of variances 
for the two groups could not be assumed, 
which introduces certain difficulties for stand- 
ard statistical treatment. An inspection of the 
data suggested that the extreme scores of six 
schizophrenic subjects (high in distortion) ac- 
counted for the marked variance of the ex- 
perimental group. When the extreme distor- 
tion scores made by these subjects (a total of 
11 scores) were eliminated and the chi square 
was computed again, homogeneity of variances 
could then be accepted. We now felt justified 


paranoid schizophrenics produced significantly 
more distortion than the normal controls (be- 
yond the 1 per cent level of confidence). Com- 
paring the groups on individual stories showed 
significant differences in stories 2-A (1 per 
cent level) and 1-B (5 per cent level) which 
does not suggest any particular pattern. The 
interaction term between the diagnostic cate- 
gories and stories was not significant, indi- 
cating the experimental subjects did not react 
to the materials in a different manner than did 


the controls. It was a reaction of greater mag- 
nitude but in the same direction. 


Table 4 
Treatment of Distortion Scores by Analysis 
of Variance 


in employing analysis of variance since discard- bier] df pass = Men F p 
ing these extreme scores depressed the mean = Sae 
distortion values for the experimental group, Total = 204 282.71 
thus working against our hypothesis. As such, aai, o1 
it would constitute a conservative or “weak” joa ; i yee pee bay 
test of significance. Individuals 53 14487 273 385 <0 
The results of the analysis of variance are Stories vs. 
presented in Table 4. It can be seen that the ~” PC A #56 152 214 NS 
ties ees a Error 144 101.73 0.71 
s coincide 


with the findings of 


Aborn wno used return of givens as one index of 


rigidity, 


In summary, the paranoid schizophrenics 
showed both significantly more distortion an 
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more variability than did the normals. It 
should be pointed out, however, that this dif- 
ference in amount of distortion is a group 
difference, with considerable overlapping be- 
tween groups. As such, it is not adequate for 
individual prediction. 


Discussion 


In light of Aborn’s findings, it would appear 
that schizophrenics do not necessarily deviate 
perceptually from normals in the immediate 
recall of controlled verbal material. However, 
when a temporal interval is interpolated be- 
tween presentation of the material and recall, 
distortion occurs. This is seemingly a result 
of the interaction of a more or less correct per- 
ception with the intervening schizophrenic 
personality variables. The results suggest that 
it is the processes underlying schizophrenic 
thought or judgment that somehow go awry. 

It is realized that there are certain diffi- 
culties in comparing the findings of this re- 
search with those of Aborn. Since two modifi- 
cations in his methodology were used, the 
question arises as to which variable accounts 
for the distortion. The interpolated time in- 
terval has already been discussed. The other 
Possibility lies in the nature of the subjects 
used. Although Aborn’s group of schizophren- 
ics of various subtypes was comparable to 
that of this research in terms of such charac- 
teristics as age, education, and intelligence, our 
experimental group was confined to paranoid 
schizophrenics. Since the principle criterion in 
formulating the diagnosis of “paranoid schiz- 
ophrenia” is the presence of “projective” think- 
ing (as seen in delusions), this factor may be 
the crucial one in producing distortion. The 
answer to this question seems obtainable in 
further research with this technique in which 
the following comparisons would be made: (a) 
Paranoid schizophrenics vs. normals without 
the temporal interval; and (4) nonparanoid 
schizophrenics vs. normals with the temporal 
Interval. 
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Summary 


‘The purpose of this research was to investi- 
gate distortion, a characteristic often attri- 
buted to the behavior of schizophrenics. The 
methodology employed four short stories des- 
cribing hypothetical people and a word-selec- 
tion checklist. After reading each story, the 
subject spent five minutes on a simple motor 
task. He was then presented with the checklist 
and asked to check all the words he would use 
to describe the person in the story. A distor- 
tion was defined as the checking of a word 
which was inconsistent with the given trait 
pattern of a story. The subjects consisted of 27 
paranoid schizophrenics and 27 normals, the 
two groups being equated for age, education, 
and intelligence. A statistical analysis of the 
data revealed that the experimental group 
showed both significantly more distortion and 
more variability than the normals. The results 
were compared and discussed in terms of the 
findings of Aborn, who developed the basic 
methodology used in this research. 


Received June 23, 1952. 
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Some Effects of Sodium Amytal on 
“Deteriorated” Schizophrenics 


Willard A. 


State College of 


Conflict still exists as to the nature of schizo- 
phrenia, much of the controversy centering 
upon whether this pathology is of an organic, 
functional, or psychosomatic nature. Schizo- 
phrenic “deterioration,” in particular, remains 
obscure as to nature and genesis, and it is ob- 
vious that more knowledge is necessary for 
best clinical results. Three types of theories 
are advanced to explain schizophrenic deterio- 
ration, i.e., schizophrenia is a progressive, or- 
ganic disease; schizophrenia is a strictly func- 
tional disorder which serves some defensive 
function in the psychological economy of the 
individual; and, schizophrenia is a psychoso- 
matic malady, and causal factors as well as 
disease processes may be both organic and 
functional. Cameron [2] notes that a rigid or- 
ganic point of view usually implies actual brain 
deterioration not amenable to anything but 
physiological treatment, and with little hope of 
full restitution of intellectual efficiency. 

The usual definition of schizophrenic de- 
terioration is descriptive, but recently Levy 
and Kennard [7] have advanced a concept of 
deterioration with more objective criteria. 
Their study shows a relationship between 
clinical judgment of deterioration, abnormal- 
ity of EEG records, and significantly large 
Wechsler-Bellevue deterioration ratios. These 
criteria can be duplicated by other investiga- 


*This Paper is derived from a study done as a 
master’s thesis under the direction of Dr. J. H. El- 
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tors, and comprise the operational definition 


of schizophrenic deterioration used in this pa- 
per. 


If schizophrenic deterioration can be allevi- 
ated without organic change, psychological 
therapies would appear to offer hope for re- 
habilitation of deteriorated patients. Layman 
[5, 6] has demonstrated that it is possible to 
obtain a temporary improvement in the intel- 
lectual performance of an unselected group of 
schizophrenics through injections of sodium 
amytal. There is evidence [1, 8, 9] which in- 
dicates that these results may come from 
changes in motivational states which come 
about as a result of the action of this drug. 
The problem investigated in this paper can be 
stated as follows: can a statistically significant 
improvement in performance be obtained from 
deteriorated schizophrenics, as defined by the 
criteria suggested by Levy and Kennard, while 
the patients are under the influence of sodium 
amytal ? The working hypothesis was that such 
an improvement could be obtained because of 
motivational changes resulting from the drug. 


The nature of the criteria suggested the fol- 
lowing secondary hypotheses: if schizophrenia 
is a progressively disabling disease, there 
should be a significant negative correlation be- 
tween the subjects’ ages and their obtained 
1Q’s; and there should be a significant posi- 
tive correlation between the improvement ob- 
served under amytal and the size of the de- 
terioration ratio. This latter hypothesis 1S 
based on the assumption that the Wechsler- 
Bellevue deterioration ratio does measure Of- 
ganic damage, and that the greater the amount 


of tissue pathology, the greater the amount of 
potential improvement. 


Effects of Sodium Amytal on 


Procedure 


The criterion given the most weight in the 
selection of subjects was clinical judgment, in- 
asmuch as behavior itself is basic to any con- 
cept of deterioration. As an additional pre- 
caution, the theorized progressive nature of the 
disease was allowed for by selecting only sub- 
jects who were considered to have had the ill- 
ness for at least five years. The abnormality 
of the EEG records was determined by a com- 
petent specialist. The minimum Wechsler- 
Bellevue deterioration ratio acceptable for the 
experimental group was 15 per cent after cor- 
rection for aging—as Wechsler [11] suggests 
10 per cent as a minimum significant figure. 
All subjects who had been subjected to any 
kind of therapy after the original testing were 
excluded. Table 1 summarizes the mean age, 
known duration of illness, deterioration ratio, 
and IQ for both the experimental and test- 
retest groups. The test-retest group was used 
only to give some indication of usual test-re- 
test effects on long-standing schizophrenics, in- 
asmuch as the experimental control was ac- 
complished by comparing pre-amytal with post- 
amytal scores. All cases were selected from the 


same population as that used by Levy and Ken- 
nard. 


Table 1 
Mean Age, Known Duration of Illness, Deteriora- 
tion Ratio, and IQ for Experimental and 
Test-Retest Groups. 


SSS 


Mean 

Mean Deterio- 
ena N Mean Dura- ration Mean 
Age tion ratio* IQ* 
Experimental 22 43.5 13.6 31.4% 84.5 
est-retest 18 41.0 104 12.6% 100.6 


“The utilization of the criteria for selection so di- 
minished the original population that it was impossible to 


match these two groups for IQ and for deterioration 
Tato, 


The subjects, experimental and test-retest, 
Were originally tested with the Verbal section 
of Form I of the Wechsler-Bellevue Intelli- 
gence Scale in a two-week period from De- 
cember 20, 1950 to January 5, 1951. The ex- 
Perimental group was retested approximately 
"ine months later while under the influence of 


“Deteriorated” Schizophrenics 55 


sodium amytal. The final test was adminis- 
tered to the experimental group approximately 
one week later, again under conventional con- 
ditions. The test-retest group was also retested 
at this time. 


Results 


‘The results obtaincd can be said to bear 
out the hypothesis that a significant, temporary 
improvement in measured intellectual perform- 
ance would be obtained through the adminis- 
tration of sodium amytal. 


Table 2 


Mean Group Scores of Experimental and Test- 
Retest Groups on Wechsler-Bellevue Ver- 
bal Scale under all Test Conditions 


Pre- Under Post- 
Group Amytal Amytal Amytal 
Experimental 84.5 94.1 86.4 
‘Test-retest 100.6 — 101.6 


Table 2 summarizes the results, in which 
it can be seen that the mean Verbal IQ of 
the experimental group increased to 94.1 from 
84.5 under sodium amytal, and dropped back 
to 86.4 in the post-amytal testing. In other 
words, the experimental group, while under 
the influence of the drug, increased its mean 
Verbal IQ by 9.6 points (significant at better 
than the .001 level of confidence), and then 
lost 7.7. points of this gain (significant at bet- 
ter than the .001 level of confidence) when 
the same test was administered again without 
the drug. The difference between the means 
of the pre- and post-amytal conditions was not 
statistically significant, despite practice effects. 
The test-retest group improved its perform- 
ance from 100.6 to 101.6, this one-point gain 
being comparable to the 1.9-point gain be- 
tween the first and third testing of the experi- 
mental group. 

The secondary hypotheses were not con- 
firmed by the data, inasmuch as the correla- 
tions obtained in each case were insignificant. 
Thus, only the primary hypothesis, i.e., that a 


3The drug was administered intravenously in a 
solution composed of one grain per cc. of distilled 
water. No set dosage was used; the drug was dis- 
continued when the subject seemed to have reached 
a testable level which appeared optimal {rem ob- 
server judgment. - : 
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significant improvement in performance of de- 
teriorated schizophrenics could be obtained by 
injection of sodium amytal, was supported by 
the results obtained. 


Discussion 


If sodium amytal doe. not temporarily miti- 
gate organic pathology, the obtained data 
would seem to support the point of view that 
schizophrenic deterioration is not entirely 
physiological. In view of other work [8, 9], 
it would seem logical to ascribe the improve- 
ment noted to changes in the patients’ motiva- 
tion. Therapeutically, it might be expected 
that schizophrenia and its accompanying de- 
terioration may be partly mitigated by psy- 
chological methods. A permanent improvement 
in all spheres of behavior of comparable mag- 
nitude to the temporary intellectual improve- 
ment obtained in this study would be enough 
to return many deteriorated schizophrenics to 
society. Failure of such methods to date may 
be due to lack of perseverance with difficult 
patients, inadequate techniques, and lack of 
funds at the insistence of economy-minded 
legislators and administrators. 

This study suggests that the severity of the 
schizophrenic process may have little or noth- 
ing to do with length of illness. A familiar 
sight in any institution is the well-preserved 
paranoid schizophrenic of many years stand- 
ing. This study further suggests that no mat- 
ter what Wechsler’s deterioration ratio does 
measure [3, 4, 10, 11], it does not seem ap- 
plicable to schizophrenic deterioration, as no 
relationship between these ratios and the data 
could be detected.* 


Of striking interest, but difficult to evalu- 
ate, were the results obtained through the use 
of amytal with patients otherwise untestable. 
Five such patients (none of them otherwise 
used in this study) were tested, and four of 
them yielded scorable protocols with Verbal 
IQ's ranging from 60 to 95, apparently indi- 
cating that much potential is still available to 
many of the most deteriorated patients. 


. 4Subtest analysis was also sterile both in terms of 
isolating differential improvement and in terms of 
subtest scatter. Amytal improvements were evenly 
distribtud over all of the subtests, and the scatter 
remained extensive—often increasing. 


Summary 


Twenty-two deteriorated schizophrenics 
were tested to obtain psychological measure- 
ment of intellectual ability both with and 
without the use of sodium amytal. Deterio- 
rated schizophrenics were defined as those: 
who had a known illness of at least five years 
duration; who were judged clinically to be de- 
teriorated; who showed a significantly large 
Wechsler-Bellevue deterioration ratio; and 
who showed an abnormal EEG record. A test- 
retest group, comparable in age, length of ill- 
ness, and clinical judgment was used to obtain 
some data on test-retest effects. 

The experimental group was administered 
the Verbal Scale of the Wechsler-Bellevue 
three times—the first time conventionally, the 
second time under sodium amytal, and the 
third time under usual conditions. The test- 
retest group was conventionally tested twice. 
The primary hypothesis tested was that a sta- 
tistically significant improvement in perform- 
ance would be obtained with subjects under 
sodium amytal over non-amytal tests. This hy- 
pothesis was confirmed by the data, as these 
differences were statistically reliable, while the 
differences between the first and third testings 
were statistically insignificant. 

A discussion of implications for psychother- 
apy followed indicating that the obtained re- 
sults support the argument that psychotherapy 
might be successfully utilized with deterio- 
rated schizophrenics, and that such patients 
still have a potential capacity beyond their ob- 
served behavior. The applicability of the 
Wechsler-Bellevue deterioration ratio to this 
illness was considered, the conclusion being 
that such use was of extremely doubtful va 
lidity. The over-all conclusion from this stu ny 
was that there is a functional component 1” 
schizophrenic deterioration which may be 
amenable to psychological methods. 


Received July 28, 1952. 
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Influence of Socioeconomic Status on Wechsler 
Intelligence Scale for Children: 
An Exploratory Study 


Betsy Worth Estes 


University of Kentucky 


The present study is a preliminary explora- 
tion toward determining whether socioeconom- 
ic level affects responses to the items of the 
Wechsler Intelligence Scale for Children so 
that test differences between upper and lower 
socioeconomic levels are manifest in: 

1. The distribution of IQ’s (means and 
variances). 

2. The prediction value of the WISC, i.e., 
its correlation with an achievement test. 

3. The pattern of test responses as indi- 
cated by subtests and intercorrelations between 
the subtests. 


Subjects and Procedure 


Two groups of children were studied: one 
of upper economic status (N=40), one of low 
economic status (N==40). The subjects in the 
upper economic group were from the univer- 
sity school, which is essentially a public 
school except for the nominal tuition charged. 
This school is one of several in which can be 
found a fairly large number of children from 
very comfortable homes—upper economic 
status. The fathers of these children are uni- 
versity professors, lawyers, physicians, bankers, 
editors, merchants, clergymen, etc. “he sub- 
jects in the low economic group were from 
five public schools. The fathers of these 
children are day laborers, night watchmen, 
junk collectors, etc. 

Of the total of 80 children, one-half were 
boys and one-half were girls. One-half were 
seven years of age, plus or minus two months, 
and in the second grade; the other half were 
ten years of age, plus or minus two months, 
and in the fifth grade. These two ages were 
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selected in order to investigate whether dif- 
ferences in socioeconomic level effect differ- 
ences in the pattern of test responses as com- 
pared with the intercorrelations of the sub- 
tests with those at seven and ten as published 
by Wechsler [9]. 

To determine socioeconomic level, the 
Warner-Mecker-Eells’ Index of Status Char- 
acteristics was used [8]. This index uses 
four factors: occupation of father, source of 
income, house type, and characteristics of the 
dwelling area. The factors are rated and a 
weighted total of the ratings is obtained. ‘The 
total is converted to social-class equivalence as 
upper-upper, lower-upper, upper-middle, low- 
er-middle, upper-lower, lower-lower. ‘Table 1 
shows the social class ratings of the subjects 
in the study. There is no overlapping of the 
two groups. The subjects were selected only 
on the bases of sex, age, grade, and socio- 
economic level. 


Table 1 
Distribution by Social Class Level 
Second grade Fifth grade 1 
Status Index Boys Girls Boys Girls Tota 
Upper Group ð 
Upper-Upper 0 0 0 0 5 
Lower-Upper 1 0 2 2 8 
Upper-Middle 6 9 5 8 K 
Lower-Middle 3 1 3 0 
Lower Group 8 
Upper-Lower 4 0 1 3 32 
Lower-Lower 6 10 9 7 
Total æ æ æ a S 
1 sub- 


The WISC was administered to al 


Se 
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Table 2 
Means, SD's, Verbal and Performance Scaled Scores on the WISC i 
Second grade Fifth grade Total group 
M SD t M SD d M SD t 
Full Scale 
Upper.............. 114.4 9.49 115.65 11.14 115.02 10.37 
4.20°° 1.96 4.09%* 
Teo RE iois 101.8 8.99 108.15 12.45 104.98 11.31 
Verbal Scores 
jiso T Sr 72.65 8.67 78.0 9.28 
3.94** 2.06 
TONT Tinaas 61.65 8.98 71.0 12.06 
Performance Scores 
Uppetercceeecsene 70.0 11,95 68.0 11.68 
2.62" 1.63 
Lower... 614 8.53 62.0 11.58 


**Sisnificant at the 1 per cent level. 
* Significant between the 1 and 5 per cent levels. 


jects. The full scale of twelve subtests was 
used. 

The second problem, that of “validity,” was 
approached by giving all subjects the Metro- 
Politan Achievement Test. The second-graders 
took Primary I Battery, Form R. The fifth- 
graders took the abbreviated form of the In- 
termediate Battery, Form R, which included 
tests of reading, vocabulary, arithmetic funda- 


Mentals, arithmetic problems, English, and 
Spelling, 
The third problem was investigated by 


Means of intercorrelations of subtests of the 
WIS 


SC computed for the subjects in this study. 


Results 


E ' i i 
Does Socioeconomic Level Effect Differ- 
ences in Distribution of IQ’s? 


of k Analysis of variance using the method 
dots Measurements on the same sub- 
Edy. analogous to the method described by 
Varied. S. Pij shows that scores on the WISC 
with With socioeconomic level, with sex, and 
I Verbal and performance halves of the 
SC. Scores were analyzed in terms of 


1 
hes Ted 


tation 


ben, Ce Printing costs Tables 5, 6, 7, 8 and 9 
ren deposited with the American Documen- 
Institute, Order Document 3837 from Ameri- 
Bress Wnentation Institute, c/o Library of Con- 
ofn oShington 25, D.C., remitting $1.00 for 
A 1Mages 1 inch high on standard 35 mm. 
ches) Picture film) or $1.00 for photocopies (6 x 8 
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sex, although, since the numbers were equal, 
this variable was not of primary concern in 
this study (Table 5, deposited with ADI). 

2. Table 2 shows a difference in mean IQ 
for the total group, i.e., both grades combined. 
The mean of the upper economic group was 
superior to the mean of the lower economic 
group. The variability of the two groups as 
expressed by the SD’s did not differ signifi- 
cantly. 

When the total group is divided by grade 
(or age), it is found that in the second grade 


Table 3 
Mean IQ and SD by Grade, Economic Level, Sex 
M SD t 
Second Grade 
Upper 
Male 116.7 10.23 
1.06 
Female 112.1 9.04 
Lower 
Male 106.4 10.09 
2.53" 
Female 97.2 4.19 
Fifth Grade 
Upper 
Male 117.0 743 
1 
Female 114.3 13.93 
Lower 
Male 111.0 11.85 
998 
Female 105.3 12.38 Oo 


*Significant at better than the five ger cent level. 
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(Table 2) the difference in means is again 
very significant, better than the 1 per cent 
level. There is only one subtest in which the 
lower group exceeds the upper group—Cod- 
ing. 

In the fifth grade, however, the differences 
in means are not significant although there is 
only one subtest in which the lower group 
exceeds the upper group—Digit Span. 

Table 2 also shows the comparison of the 
verbal and performance scores on the WISC. 
The differences were significant in both verbal 
and performance scores in the second grade 
but in the fifth grade only the verbal IQ 
means differed. 

3. Table 3 presents the differences in mean 
IQ for the two grades and two economic 
groups by sex. The difference is significant 
only in the lower economic group in the 
second grade. 

Thus, in answer to the first question, dif- 
ferences in socioeconomic level effect differ- 
ences in scores on the WISC for the total 
group studied. When the group is separated 
by grade (or age), however, these differences 
exist for the second grade (seven-year-olds) 
but are not significant for the fifth grade (ten- 
year-olds). 


II. Does Socioeconomic Level Effect Differ- 
ences in Prediction Value of the WISC? 


1. The second major finding was that 
there is not a significant difference between the 
two economic groups as to predictive power of 
the WISC. Using Fisher’s z transformation 
it is found that the difference between the cor- 
relations with achievement in the second grade 
(r= .54 and r=.33) is not significant at the 
5 per cent level; nor is the difference (r= 
-77 and r = .46) significant for the fifth 
grade. Thus if achievement is used as the cri- 
terion, the WISC did not predict better for 
one economic group than the other. 


III. Does Socioeconomic Level Effect Differ- 

ences in the Pattern of Test Response as In- 

dicated by Subtests and Intercorrelations be- 
tween the Subtests? 

This problem was divided into three parts: 


1. In terms of intercorrelations, how does 
the saaple used in this study compare with 
Wechsler’s standardization data? 


t 


2. In terms of intercorrelations, how does 
this sample when separated by socioeconomic 
level compare with Wechsler’s standardization 
data? 

3. Are there differences in the intercorrela- 
tions of subtests between upper economic 
status and lower economic status? 

1. Comparison of whole group with stand- 
ardization data. The intercorrelations of the 
seven and one-half year old group were com- 
pared with those presented by Wechsler [9] 
and the intercorrelations for the ten and one- 
half year old groups with those presented by 
Wechsler [9]. (See Tables 6, 7, deposited 
with ADI.) The level of 5 per cent was com- 
puted by Fisher’s z transformation as given by 
Edwards [1]. 

Those which differ are Arithmetic and In- 
formation, Similarities and Comprehension, 
Arithmetic and Vocabulary, Arithmetic and 
Digit Span, Arithmetic and Coding, Vo- 
cabulary and Digit Span, and Picture Ar- 
rangement and Object Assembly. Out of a 
total of sixty-six intercorrelations, nine in the 
seven and one-half year group differ at the 5 
per cent level from Wechsler’s. 

At the ten and one-half year old level, the 
r’s which differ from Wechsler’s are Informa- 
tion and Arithmetic, Comprehension and Digit 
Span, Arithmetic and Vocabulary, Arithmetic 
and Digit Span, Arithmetic and Picture Ar- 
rangement, and Arithmetic and Coding. That 
is, six intercorrelations out of sixty-six differ at 
the 5 per cent level. 

The striking observation in those tests which 
differ is that it is Arithmetic which so frequent- 
ly enters into the intercorrelations. At seven 
years old, six out of the nine which differ are 
combinations including Arithmetic, and at ten 
years old, five out of the six include Arithmetic. 
In each of these cases, the intercorrelations in 
this study are lower than those presented by 
Wechsler. Since Arithmetic is so strongly 10-7 
fluenced by school training, this may be a re- 
flection of differences in educational systems. 

Since only nine at the seven and one-half 
year level (out of sixty-six) and six at the ten 
and one-half year level (out of sixty-six) differ 
from Wechsler’s data, we assume that our 
groups conform to the standardization data 
and that they are representative. : 

2. Comparison of group separated on basis 


ie Points. A minus sign indicates that the lower eco- 


Influence of Socioeconomic Status on the WISC -61 


of socioeconomic level with standardization 
data. Each age group was separated according 
to socioeconomic level and the intercorrelations 
compared with Wechsler’s standardization 
data for each age. Again no essential differ- 
ences from the standardization group were 
found. (See Tables 8, 9, deposited with ADI.) 

(a) In the upper economic group at seven 
and one-half years, those r’s which differ be- 
yond the 5 per cent level are Information and 
Picture Arrangement, Information and Block 
Design, Information and Object Assembly, In- 
formation and Mazes, Arithmetic and Vo- 
cabulary, Arithmetic and Picture Completion, 
Arithmetic and Picture Arrangement, Arith- 
metic and Block Design, Similarities and Pic- 
ture Arrangement, Vocabulary and Digit 
Span, Vocabulary and Object Assembly, Vo- 
cabulary and Coding, and Vocabulary and 
Mazes. 

Those which differ in the lower group at 
seven and one-half years are Information and 
Arithmetic, Arithmetic and Vocabulary, Arith- 
metic and Digit Span, Arithmetic and Coding, 
Vocabulary and Digit Span, Digit Span and 
Object Assembly, Picture Arrangement and 
Object Assembly, and Object Assembly and 
Mazes. 

Thus in the upper group thirteen intercor- 
relations out of sixty-six differ from Wech- 
sler’s; in the lower group, eight differ. Since 


Table 4 


Scaled Score Differences between Economic 
Groups in Subtests 


Differences in economic 
groups in points 


Subtests Second grade Fifth grade 
tests Second grade Fifth grade 
Information 49 18 

OMprehension 43 36 
Tithmetic 12 3 
Imilarities 58 43 
Scabulary 53 50 
"git Span 5 -10t 
“ture Completion 10 12 
(ture Arrangement 51 32 
lock Design 48 23 

Ject Assemb] 37 32 

Coding x -9t 16 


Mees E 


No sign indicates that the upper economic group had 


mi, 
© group was superior. 


the number of cases was so much smaller in 
this study than in Wechsler’s group, it is as- 
sumed that there are no essential differences. 

(b) At ten and one-half years, in the upper 
economic group, differences from Wechsler’s 
are obtained in eight intercorrelations: In- 
formation and Arithmetic, Comprehension and 
Digit Span, Comprehension and Picture Com- 
pletion, Arithmetic and Digit Span, Arithmetic 
and Picture Arrangement, Arithmetic and 
Coding, Similarities and Picture Completion, 
and Vocabulary and Block Design. 

In the lower economic group, there are no 
r’s which differ significantly from the stand- 
ardization data. 

3. Intercorrelations of subtests according to 
socioeconomic level. The third comparison 
(Table 8, ADI) is of intercorrelations accord- 
ing to socioeconomic level. At seven and one- 
half years five r’s differ according to socio- 
economic level: Information and Picture Ar- 
rangement, Arithmetic and Picture Arrange- 
ment, Vocabulary and Coding, Digit Span and 
Block Design, and Digit Span and Object 
Assembly. 

At ten and one-half years, (Table 9, ADI) 
only two r’s differ according to socioeconomic 
level: Arithmetic and Digit Span, and Picture 
Arrangement and Object Assembly. 

Table 4 shows the differences between eco- 
nomic groups in the subtests in standard score 
units. In general, it is the verbal items that 
show the greatest differences—Vocabulary, 
Similarities, Comprehension. 

The results of this study, therefore, suggest 
that socioeconomic level effects differences (a) 
in magnitude of scores on the WISC but not 
(b) in pattern of scores and (c) that socioeco- 


nomic level does not effect differences in pre- 
diction value of the WISC. 


Discussion 


Several explanations might be suggested for 
the decrease in socioeconomic effects on Wech- 
sler IQ with increase in age or grade. Does 
a selective factor operate so that only the 
brightest of the lower economic group persist 
to reach the same grade at the same age as the 
upper economic group? The duller ones may 
still be in the third and fourth grades and 
only the most capable regularly promoted. 
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Is it possible that the public schools are nar- 
rowing the differences occasioned by economic 
status in the home so that with increase in age, 
there is a decrease in the discrepancy between 
measured IQ in the economic groups? Many 
studies have shown a decrease in IQ with in- 
crease in age [3, 7]. However, the pupils in 
these studies were continuing in an extremely 
impoverished environment with a minimum of 
stimulation. The subjects in this study were 
in good public schools where there was con- 
stant encouragement and stimulation. This is 
an attractive explanation if its validity could 
be established. 

A third explanation may be consonant with 
research at the University of Chicago [2, 4, 5, 
6], that test items are constructed for and 
favor the middle and upper economic groups 
and penalize the lower group. Thus at an 
early age when the home environment is most 
influential, the lower group does poorly. At a 
later age, the middle-class influences of school, 
Sunday School, movies, etc., are beginning to 
be evidenced and may affect responses on the 
WISC. 

Since this study suggests that socioeconomic 
differences as reflected in the WISC decrease 
with age, the WISC may become a preferred 
test in clinical and educational situations at 
older ages. Future studies might investigate 
this hypothesis at older ages than used in the 
present study. 


Summary and Conclusions 


Two groups of subjects, of upper and of 
lower economic level, 40 in each group, were 
selected on the bases of age, sex, grade, and 
socioeconomic status. One-half were seven and 
one-half years, plus or minus two months, in 
the second grade; one-half were ten and one- 
half years, plus or minus two months, in the 
fifth grade. One-half were boys; one-half were 
girls. 

Socioeconomic level was determined by the 
Warner-Meeker-Eells’ Index of Status Char- 
acteristics. There was no overlapping between 
the two groups. 

The full scale of twelve subtests of the 
Wechsler Intelligence Scale for Children was 


administered. The Metropolitan Achievement 
Test was given to each subject. 


The results were analyzed as a preliminary 
exploration toward determining whether socio- 
economic level affects responses to the items 
of the WISC so that test differences between 
upper and lower socioeconomic levels are mani- 
fest in: 

1. The distributions of 1Q’s. 

2. The predictability of the WISC. 

3. The pattern of test response as indicated 
by intercorrelations of the subtests (a) with 
Wecehsler’s standardization data and (b) be- 
tween economic levels. 

Scores on the WISC vary with sociocco- 
nomic level in respect to magnitude of score; 
the upper economic group was superior to the 
lower economic group. When the groups 
were divided by age or grade, the difference 
was significant at the seven and one-half year 
level, not significant at the ten and one-half 
year level. i 

The WISC did not predict better for one 
economic group than for the other. 

Patterns of scores on the WISC did not 


appear to be differentiated by socioeconomic 
level. 
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A Comparison of the Wechsler-Bellevue and ACE 
Tests on a University Counseling Center Group 


Reed M. Merrill and Louise B. Heathers 


University of Washington Counseling Center 


As indicated by the many studies reviewed 
by Rabin [6], Watson [9], and Rabin and 
Guertin [7], the Wechsler-Bellevue Intelli- 
gence Scale (W-B) is very widely used as a 
measure of general ability. Relatively few 
studies, however, have been made regarding 
its validity for predicting academic perform- 
ance at the college level. In this study W-B 
1Q’s are compared with scores on the Ameri- 
can Council on Education Psychological Ex- 
amination (ACE). The ACE was selected 
because of its widespread use as the measure of 
scholastic aptitude given entering college 
freshmen. Two points are of interest: (a) 
the relative capacity of the two tests to predict 
academic achievement at the college level and 
(b) the relationship between the scores ob- 
tained on the two tests. 

r These relationships have been investigated 
In three previous studies. Anderson [1] gave 
the W-B and the ACE to all but two members 
of an entering freshman class in a woman’s 
college. The 1940 ACE was given on en- 
trance; the W-B, some time during the stu- 
dent’s second semester. ACE raw scores were 
used in the correlations. The mean Verbal, 
Performance, and Full Scale W-B IQ’s for 
this group of 112 Ss were 116.0, 115.8, and 

5, respectively. Sartain [8] gave the W-B 
and the 1942 ACE to 50 college freshmen. 

€ sex of the Ss was not specified. Presum- 
ably they were volunteers. ACE raw scores 
Were used in the computations. The mean Ver- 
hey Performance, and Full Scale W-B IQ’s 
i this group were 115.4, 115.1, and 117.5, 

Pectively. The measure of scholastic 

achievement used in both studies was the 
stat Point average (GPA) obtained by a 
ent during his freshman year. Gerboth 


[3], in studying the relationship between Forms 
I and II of the W-B, gave Form I to 25 men 
and 25 women at some time during their col- 
lege career. The median class placement of 
the Ss was at the sophomore level but all 
classes were represented. Presumably these 
Ss were volunteers. Some of these Ss had 
taken some form of the ACE on entrance. 
The number of Ss in the Form I group for 
whom ACE scores were available and the 
average time interval between the two testings 
are not known. Since various forms of the 
ACE had been taken by the Ss, ACE centiles 
were used in the computations. The measure 
of scholastic achievement used was the GPA 
obtained during one semester, probably the 
semester during which the W-B was given. 
The mean Verbal, Performance, and Full 
Scale W-B IQ’s for this group were 124.4, 
122.1, and 125.6, respectively. 

The study reported here was based on 251 
male students who were part of a larger sam- 
ple seen over a two-year period at a university 
counseling center. The total group of Ss is 
described in detail elsewhere [5]. The 251 Ss 
were those members of the original group who 
had taken some form of the ACE as entering 
freshmen at the University of Washington. 
Since the W-B was taken at the time the stu- 
dent came to the counseling center, the class 
level of the Ss and the time interval between 
the two test administrations varied. When they 
were given the W-B, 55% of the Ss were 
freshmen, 31.5% were sophomores, and 13.5% 
were upper-division students. Their median 
age at this time was 20.96 years with a Q 
of 2.26 years. The median time interval be- 
tween the two tests was 11.02 months with a 
Q of 8.52 months. The measure of scholastic 
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performance was the GPA achieved in aca- 
demic subjects for the freshman year. The 
mean GPA! was 2.10 with a standard devi- 
ation of .63 and a range from 0.0 to 3.8; the 
mean GPA for all freshmen at the University 
of Washington during the period covered 
by the study was 2.2.2 Table 1 pre- 
sents the mean W-B IQ's and mean local 
entering-freshmen centiles obtained by the 
group. Local centiles were used in all compu- 
tations since various editions of the ACE had 
been taken by the Ss and these centiles were 
more stable from year to year for the local 
population than the national centiles. 


Table 1 


Means and Standard Deviations on the W-B and 
the ACE Tests of Student Client Group 


(N= 248) 
Wechsler-Bellevue IQ’s 

Verbal Performance Full 

Scale Scale Scale 
Mean 117.70 118.21 120.07 
o 8.55 9.72 8.64 

Local ACE Centiles 

Q Scale L Scale T Scale 
Mean 52.25 47.75 49.05 
o 28.10 29.30 29.00 


As may be seen in Table 2 the correlations 
found between GPA and both the W-B IQ's 
and the ACE scores tend to be quite similar 
in the four studies. In general the W-B Full 
Scale predicts college achievement as well as 
does the Total ACE. The Verbal Scale pre- 
dicts achievement better than any of the other 
scales while the Performance Scale predicts 
less well than any of the other scales. The re- 
sults on the ACE are in agreement with those 
reported by Berdie eż al. [2]; ie., (a) the Lin- 
guistic (L) Scale predicts general achievement 
as well as the Total ACE Scale and somewhat 
better than the Quantitative (Q) Scale, and 
(b) the correlations between grades and ACE 
scores are consistently higher for the female 
than for the male groups. It is of interest that 


Since three students withdre i i 
R s w prior to obtain- 
ing any grades, all data i i 
on 248 instead of 251 C one 


ŽA grade of C has a poi t 
University. of Wahne int value of 2.0 at the 


Table 2 
Comparison of Correlations of W-B IQ's and of 
ACE Scores with GPA in the Four Studies 


GPA, W-BIQ GPA, ACE Score 
Study 


V P FS Qa & T 
Anderson [1] S2 a AS 36 48 49 
Student Clients® 58.17) 46 27 .39 .40 
Sartain [ 8] 58 53 35 44 43 
Gerboth [3] — — 29 = 


*All r's significant above the 19% level. 


this sex difference does not appear in the W-B 
correlations with GPA. 

Table 3 gives the significance of the differ- 
ences between the correlations with GPA ob- 
tained in this study. In obtaining the ¢ ratios, 
r’s were transformed into Fisher's z's, a 
statistic whose sampling distribution is normal 
and independent of the magnitude of the uni- 
verse r. Since the correlations compared were 
all based on the same group, McNemar’s [4] 
procedure for estimating the standard error 
of the difference between z’s was employed. 
This technique takes into account the inter- 
correlations between the measures. 


Table 3 


Significance of the Differences between Correlations 
with GPA on the Student Client Group 


(N=248) 
Be 
Comparison gi — g Oe t 

FS vs. T +.073 061 1.20 

V vs. FS +.166 045 3.69% 
Vvs.T +.239 .062 3.85" 
Vvs.L +.251 .067 3.75* 
V vs.Q +.386 .069 5.59 
V vs. P +.491 071 6.92" 
P vs. FS —.325 041 7:97% 
P vs. T —.252 .070 3.60* 
Pvs.L —.240 .075 3.20% 
P vs.Q —.105 .070 1,50 

Lys.Q +135 .067 2.01 

Tvs.Q +.147 044 3.34" 


$$ 
*Significant above the 1% level. 


The results suggest that the time required 
to give the Verbal Scale is time well spent. 
This scale tends to predict college achievement 
better than does the ACE and these predic- 
tions do not appear to be affected by sex dif- 
ferences. In addition the scale provides the 
counselor with the opportunity to observe the 


quality of a student’s behavior. Such observa- 
tions are often as useful in counseling as are 
quantitative scores. One can speculate that 
academic predictions based on the Verbal 
Scale are best because it reflects, like GPA, 
both personality and ability factors. 

The results also emphasize the need to 
interpret test scores in a very conservative 
manner and the need to utilize data from more 
than one source in making predictions about 
general college achievement. For the highest 
correlation reported, .58 between the Verbal 
Scale and GPA, the coefficient of alienation 
is .81. Predictions based on a correlation of 
this magnitude are only 190 better than 
chance. Further, it should be noted that most 
correlations obtained between college GPA’s 
and tests of ability have even less predictive 
power, particularly when predictions are made 
beyond the freshman level. 

Table + presents the intercorrelations be- 
tween W-B and ACE scores found in the four 
studies. Here there is more variability in the 
results, particularly with those involving the 
Performance Scale. The most noteworthy 
finding is that, in all four studies, the Verbal 
Scale predicts the various ACE scores as ade- 
quately as does the W-B Full Scale. In most 
of the comparisons the Performance Scale 
Predicts ACE performance less well than does 


, Table 4 
Comparisons of Intercorrelations of the W-B IQ's 
and ACE Scores in the Four Studies 


Ander- Student Sar- Ger- 
Corre. son[1]  Clients*  tain[8] both [3] 
lations (N=112)  (N=251)  (N=50) =7) 
V.Q «49 .50 50 - 
VL BL BA 72 = 
VT 54 61 68 57 
VP 34 43 53 — 
VFS ai 81 87 = 
BQ 31 42 50 = 
BL 19 «35 54 = 
PT 25 43 55 = 
PFS = 80 84 = 
FS,Q = 55 55 = 
PSL = 54 mı = 
FST 48 61 69 58 
a 61 49 60 = 
QT ie 29 19 _ 
= — 91 94 — 


+ 
All rg Significant above the 1% level. 
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the Verbal Scale. Table 5 shows the signifi- 
cance of the differences between the inter- 
correlations between W-B and ACE scores 
found in this study. 


Table 5 


Significance of the Differences between Intercorrela- 
tions between W-B IQ's and Local ACE Cen- 
tiles for the Student Client Group 


(N=251) 
Comparison Z — Ly o . t 
EE i. 
—.069 -045 1.53 
-00 — — 
00 — — 
—.055 071 0.77 
—.160 -048 3.33% 
—.105 .039 2.69* 
—.238 071 3.359 
—.249 -075 3.32% 
—.101 073 1.38 
s +.082 -068 1.21 
VEGE +.068 082 0.83 
VP vs. QL —.076 081 0.93 


“Significant above the 1% level. 


These intercorrelations are too low to sup- 
port the assumption that, in normal persons, 
performance level on various kinds of ability 
tests should be highly similar. They are too 
high to support the assumption occasionally 
implied in test interpretation that the different 
scales of the two tests measure discrete abil- 
ities. 

Summary 


Correlations between college freshmen 
GPA’s and the various W-B and ACE scales 
are reported. The findings of Anderson, Sar- 
tain, and Gerboth are reviewed and compared 
with the results found on 248 male student 
counseling center clients. Similar comparisons 
are made relative to the intercorrelations be- 
tween the W-B and the ACE scales. 

The L Scale of the ACE predicts the gener- 
al academic achievement of college freshmen 
as well as the Total ACE and better than the 
Q Scale. Correlations between ACE scores 
and grades are higher for women than for 
men; this trend is not apparent on the W-B. 
The Verbal Scale of the W-B appears to be 
the best single predictor of the general aca- 
demic achievement of freshmen. It also predicts 
the Q, L, and Total Scales of ths ACE as ade- 
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quately as does the Full Scale of the W-B and 
predicts the L Scale about as adequately as 
does the Q Scale. The Performance Scale is 
least related to both academic achievement and 
the various ACE scales. It is possible that the 
reduced correlation between the Verbal and 
Performance Scales is due not only to the re- 
stricted range of talent in the college samples 
but also to the fact that, at this level of ability, 
the two scales do not measure similar factors. 
The data definitely support the use of the 
W-B as a predictor of the academic achieve- 
ment of freshmen. This test, especially its Ver- 
bal Scale, predicts as well as the ACE, a test 
specifically designed to predict the academic 
achievement of college freshmen. 

However, all of the obtained correlations 
are of such a magnitude that predictions re- 
garding an individual student’s academic 
achievement in freshmen college courses are 
subject to considerable error. Though data 
such as found in this study are a valuable aid 
in student counseling, one does well to note 
the variance that is unaccounted for in such 
results. Thus we believe that test scores are 
only part of the data that must be considered 
by a qualified counselor in helping students 
make decisions related to college achievement, 
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The Effect of Variations in Ambiguity on Pro- 
jection in the Children’s Apperception Test” 


Edith A. Weisskopf-Joelson and David B. Lynn 


Purdue University 


How the degree of ambiguity of projective 
pictures affects the amount of projective ma- 
terial elicited by these pictures is a question 
which concerns the clinical practitioner as well 
as the theoretician. The former might be helped 
in the selection of effective pictures for projec- 
tive techniques if he had the answer to this 
question. The latter might profit from gaining 
insight into the relationship between two im- 
portant variables, namely, projection and am- 
biguity of the stimulus. 


It is generally assumed that projection in- 
creases with increasing ambiguity. Experi- 
mental studies appear to corroborate this im- 
Pression [1, 3, 4, 5, 6, 8, 10, 11, 15] with few 
exceptions [7, 13, 14, 16]. One of the excep- 
tions is a study by Weisskopf [16], in which 
the ambiguity of TAT pictures was increased 

Y two methods: (a) by incomplete tracing of 
the contours of the pictures, (b) by short ex- 
Posure of the pictures. In both cases it was 
found that the more ambiguous pictures 
elicited less projection than the less ambiguous 
Ones, when college students are used as sub- 
Jects, 

: The present study attempts to test the valid- 
Ity of the above results for a different group 
of subjects, namely, for children. 


Subjects and Materials 


The subjects were 50 children, ranging in 
age from nine years to nine years and eleven 
Months, All subjects attended the fourth grade 


‘The is on a thesis presented to the 
oae n or cig ie University, Lafayette, 
Ndiana by the junior author in partial inleme 
Ot the requirements for an M.S. degree in psychol- 
By. The study was directed by the senior author. 
his study was reported at the annual meeting 


of the Midwestern Psychological Association, De- 
troit, 1950, 


of the same public school. Their IQ’s on the 
Revised Stanford Binet Intelligence Scale, 
Form L, ranged from 83 to 154, with a mean 
of 116 and a standard deviation of 15.57. 

Ten pictures were selected from Bellak’s 
Children’s Apperception Test (CAT) [2]. 
These pictures were reproduced by incomplete 
tracing of the contours, i. e., part of the con- 
tours were omitted in order to increase the am- 
biguity. Figure 1 shows Picture 6 of the CAT 
incompletely traced. The pictures used for 
control purposes were modifications of the 
same ten pictures of the CAT. They were ob- 
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Fig. 1. Picture 6, incompletely traced. 


Fig. 2. Picture, 6, completely traced. 
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tained by completely tracing the contours of 
the pictures, as illustrated in Figure 2. Thus, 
the material consisted of an experimental set of 
ten incompletely traced pictures and a control 
set of the corresponding ten completely traced 
pictures. 


Procedure 


The pictures were administered individually 
to each subject. The experiment was con- 
ducted in two sessions with a two-week inter- 
val between sessions. The incomplete pictures 
were administered in the first session and the 
complete ones in the second session. The order 
Was never reversed because it can be expected 
that previous exposure of the complete pic- 
tures might decrease the ambiguity of the in- 
complete ones, However, it is reasonable to 
assume that the effect of repetition did not 
affect the results, since a previous unpublished 
study by Weisskopf shows that mere repetition 
of administration does not alter the transcend- 
ence index of incomplete pictures. 

The instructions requested that the children 
“tell all about the picture.” These instructions 
were used rather than the ones suggested by 
Bellak [2] in order to keep the procedure as 
similar as possible to the one followed by 
Weisskopf [17], who used the instructions 
“describe the picture.” However, when using 
children as subjects, it was found advisable to 
change this latter phrase to one which has a 
similar meaning but is easier understood by 
children. 

The amount of projection elicited by the 


pictures was measured by transcendence in- 


dices, a measure discussed in Previous studies 
[16, 17, 18]. 


he transcendence index of a picture is ob- 


tained as follows: the Subjects are asked to 
describe the Picture, 


transcendence indices make such imper- 
al obser yatian difficult and, as it were, “lure” 


the subjects away from the objective path pre- 
scribed by the instructions and “force” him to pro- 
ject [17, p. 379]. 

The deviations from objective description 
were scored in terms of various categories 
such as the following: 


Intraception refers to the ascribing of emotions, 


desires, thoughts, fantasies, etc, to figures in the 
picture. . . . Temporal Transcendence refers to the 
inclusion of events which occur prior to, or after 


the event shown on the picture. . . . Relationship 
refers to the characterization of figures as related 
to other figures in the same picture. The great ma- 
jority of relationship scores refer to kinship, as 
when one figure is described as the father, mother, 
son, daughter, husband, wife, etc, of another fig- 
ure... . Content of speech refers to verbal state- 
ments made by pictorial figures. . . . Atmosphere 
refers to the characterization of the whole picture 
or parts of the picture in terms of the emotional 
Tesponse which it elicits in the observer. . , , Jm- 
erative refers to comments to the effect that a 


pictorial figure “should,” “must,” “is supposed to,” 


act, feel, or think in a certain manner [17, p. 382- 
383]. 


The interjudge reliability, and the test-re- 
test reliability of transcenden 
been previously discussed [18]. 

The score-rescore reliability of the junior 
author was found to be .98 for the complete 
pictures as well as for the incomplete ones. 

he junior author and two additional 
judges scored the entire story material. Thus, 
each judge obtained a transcendence index for 
each picture. The mean of these three indices 
was used as the final transcendence index of 
the picture. The estimated reliability of this 
mean was found to be .96 for the complete 
Pictures and .73 for the incomplete pictures 
[12]. The interjudge reliabilities of three 
Judges ranged from .86 to .94 for the complete 


Pictures and from .44 to .90 for the incom- 
plete pictures, 


ce scoring have 


Results 


The mean transcendence index for the in- 
Complete pictures js -60, for the complete 
Pictures, 1.48. The difference between the two 
Means is Statistically significant well beyond 
the 1 per cent level. An individual comparison 
of each incomplete picture with the corres- 
ponding complete picture yields a difference in 
the same direction for eight out of ten pic- 
tures. Seven of these eight differences are sig- 


d 
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nificant beyond the 1 per cent level, while one 
is significant between the 1 and 2 per cent 
level, 


Discussion 


The results of this study are in agreement 
with those of the above-mentioned study by 
Weisskopf; which investigates the same prob- 
lem, using adults as subjects. “It seems that 
the subjects, when confronted with an indefi- 
nite and highly equivocal stimulus, produce 
less fantasy material than if confronted with 
a more definite picture” [16, p. 412-3]. The 
results of both studies are in agreement with 
Sears’s [14] findings pertaining to doll play. 

The implications of the results for the 
development of pictorial projective techniques 
have been presented in the earlier study: 


Can the results of this : +» Study help the origi- 
nators of pictorial Projective tests to select pictures 
of high diagnostic value? The author believes that 
the answer is in the affirmative... , 

Are highly ambiguous or are highly structured 
Pictures of greater diagnostic value? By increasing 
the degree of ambiguity of a picture , , . [by in- 
complete tracing], the production of fantasy ma- 
terial going beyond perception, such as the ascrib- 
ing of emotions to human figures, or the imagina- 
tive creation of past and future events, is de- 
Creased. . . | Such a decrease would be a loss for 
diagnostic Purposes, because transcendent material 
of this kind can be used as a basis for clinical di- 
agnosis, However, this loss is probably accom- 
Panied by a gain in another direction, Even though 
highly ambiguous pictures do not elicit as much 
Material beyond perception, they may enable the 
clinician to make diagnostic use of perception it- 
self, that is, of what and how the subject per- 
Ceives, With relatively ambiguous, unstructured 
Pictures interpretation of this latter type may be 
More fruitful than with relatively definite pictures, 

igh ambiguity of pictures increases the relative 
influence of individual differences on perception, 
as the protocols of the present study show. 

hus, by using such relatively structured ma- 
terial as the , . . pictures [of the Children’s P ppi 
CePtion Test], the clinician loses diagnostic materia 
of one kind and gains diagnostic material of an- 
other kind, He loses the possibility of basing his A 
terpretation mainly on what the subject sees in the 
Picture, since most nonpsychotic subjects “sai con- 
Sidérable agreement as. to what is actually s ve 
But he gains diagnostic material consisting of ade i- 
tions to perception, such as the imaginative creation 
of past and future events, or the ascribing of emo- 
tions and thoughts to human figures. In the Ror- 
Schach, Material of this kind is rarely produced. Ac- 
“°rding to the results of this study this comparative 


lack of transcendence in the Rorschach may be due 
to the fact that the Rorschach’ blots are so much 
more ambiguous than the , ++ pictures [of the 
Children’s Apperception Test]. “Rorschach inter- 
pretation . . . is based much more on okat and 
how the subject perceives than what he adds to 
Perception” [17, P. 380]. It “is based on transcend- 
ence of sensation rather than transcendence of per- 
ception” [17, pp. 380-381]. 

It seems that in whatever direction the ambiguity 
of projective stimuli is varied, diagnostic material 
of one kind is lost and of another is gained. eey 
Thus, the present study claims a decrease with in- 
creased ambiguity for one kind of projection 
(transcendence) only. The study of the factors 
causing the negative i 


cendence and ambiguity may be a fruitful objec- 
tive for further research [16, pp. 414-415). 


Summary 


The amount of Projection elicited by pic- 
tures was studied as a function of the ambi- 
guity of the pictures, 

The subjects were 50 nine-year-old children. 
Ten pictures from the Children’s Appercep- 
tion Test by Bellak were traced, whereby parts 
of the contours were omitted to increase the 
ambiguity. The amount of Projection elicited 
by these pictures was compared with the 
amount of projection elicited by fully traced, 
and thus less ambiguous pictures -The pictures 
with higher ambiguity elicited less projection 
than the less ambiguous pictures, This differ- 
ence was shown to be significant well beyond 
the 1 per cent level. 


Received June 25, 1952, 


References 


1. Asch, S. E., Block, H., & Hertzman, M. Stud- 
ies in the principles of judgments and atti- 
tudes: I, Two basic principles of judgment. J. 
Psychol., 1938, 5, 219-251. 

2. Bellak, L., & Bellak, Sonya S. Children’s Ap- 
perception Test, New York: C.P.S, Co., 1949, 

3. Bruner, J. S. & Goodman, C. C, Value and 
need as organizing factors in perception. J, 
abnorm. soc. Psychol., 1947, 42, 33-44, 

4. Carter, L. F., & Schooler, K. Value, need, and 
other factors in perception. Psychol, Rev., 

1949, 56, 200-207. , i 

5. Coffin, T. E. Some conditions of suggestion 
and suggestibility: A study of certain attitu- 
dinal and situational factors influencing the 
process of suggestion. Psychol. Monog., 1941, 
53, No. 4 (Whole No. 241). ee 

6. Hertzman, M. Studies in the principles of 
judgments and attitudes: III. The functional 


70 


10. 


at, 


12. 


13, 


Edith A. Weisskopf-Joelson and David B. Lynn 


equivalence of two differently structured ref- 
erences. J. soc. Psychol., 1940, 12, 3-19. 
Levine, R., Chein, I, & Murphy, G. The re- 
lation of the intensity of a need to the amount 
of perceptual distortion: a preliminary report. 
J. Psychol., 1942, 13, 283-293. 

Luchins, A. S. Social influences in perception 
of complex drawings. J. soc. Psychol., 1945, 
21, 257-273. i 

Luchins, A. S. The stimulus field in social psy- 
chology. Psychol. Rev., 1950, 57, 27-30. 
McClelland, D. C., & Atkinson, J. W. The 
projective expression of needs: I. The effect 
of different intensities of the hunger drive on 
perception. J. Psychol., 1948, 25, 205-222. 
McGregor, D. The major determinants of the 
prediction of social events. J. abnorm. soc. 
Psychol., 1938, 33, 179-204. 

Mosier, C. I. On the reliability of a weighted 
composite. Psychometrika, 1943, 8, 161-168. 
Schonbar, Rosalea A. The interaction of ob- 


14. 


16, 


server pairs in judging visual extent and 
movement: the formation of social norms in 
“structured” situations. rch. Psychol, N.Y. 
1945, No, 299. 

Sears, R. R. Influence of methodological fac- 
tors on doll play performance. Child. De- 
velpm., 1947, 18, 190-197, i 
Sherif, M. A study of some social factors in 
perception. Arch. Psychol, N. Y. 1935, No. 
187. 

Weisskopf, Edith A. An experimental study 
of the effect of brightness and ambiguity on 
projection in the Thematic Apperception Test. 
J. Psychol., 1950, 29, 407-416. 

Weisskopf, Edith A. A transcendence index as 
a proposed measure in the TAT. J. Psychol, 
1950, 29, 379-390. 

Weisskopf, Edith A., & Dunlevy, G. P. Bodily 
similarity between subject and central figure 
in the TAT as an influence on projection. J. 
abnorm. soc. Psychol., 1952, 47, 441-445. 


a hy — 


Journal of Consulting Psychology 
Vol. 17, No. 1, 1953 


Sex Sequence in the Draw-a-Person Test and its 
Relation to the MMPI Masculinity- 
Femininity Scale 


Samuel Granick 
Washington, D. C. 


and Leon J. Smith 


St. Petersburg, Florida 


Subjects are expected to draw a figure of 
their own sex as their first response to the 
examiner’s direction to “draw a person” [2, 


5, 6]. Levy [5] reports that of 5000 adults 
examined, 87 per cent drew their own sex. A 
study of 80 college students, ranging in age 
from 18 to 58 years with a median of 26, 
showed similar results, 76 per cent of the sub- 
jects drawing their own sex as their initial re- 
sponse [3]. With reference to children be- 
tween the ages of 5 and 12 years, Jolles [4] 
found that both the boys and the girls drew 
their own sex predominantly when taking the 
H-T-P Test. Data obtained from a group of 
Serbian refugee children [1], on the other 
hand, indicated that while boys showed a pre- 
ference for drawing males, girls under 10 
tended to draw their opposite sex predom- 
inantly. The girls of 11 and 12 years of age, 
however, showed a preference for their own 
sex. How adolescents tend to respond has not 
as yet, to the authors’ knowledge, been re- 
Ported in the literature. 

What the drawing of the same or opposite 
Sex as the first response to the Draw-a-Person 
test implies clinically for an individual and 
generally for various age and sex groups 
appears never to have been systematically ex- 
Plored. Machover [6] and Buck [2] empha- 
size that in drawing the human figure an 1n- 
dividual is probably making some kind of 
Portrait of himself. In Machover’s words, 
7 he process of drawing the human figure 
'S for the subject, whether he realizes it or 
Not, a problem not only in graphic skill, but 
One of projecting himself in all of the body 
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meanings and attitudes that have come to be 
represented in his body image.” She goes on 
to mention that empirically she has found 
“evidence of some degree of sexual inver- 
sion... in records of all individuals who drew 
the opposite sex first” [6, pp. 101, 102]. 

The study herein reported is not intended 
as a test of Machover’s entire hypothesis. In- 
deed that would be exceedingly difficult to 
accomplish since defining “some degree of 
sexual inversion” might prove elusive. In- 
tended, however, is an investigation of the 
incidence of self-sex drawings as the initial 
response to the Draw-A-Person test on the 
part of a group of adolescents and a compari- 
son of this with results obtained on a standard 
masculinity-femininity scale. 


Method 


The subjects for the experiment consisted of 
185 male and 386 female students in the 
general psychology course during the fall 
semester of 1950-51 at the Florida State Uni- 
versity. Since almost all students at the univer- 
sity tend to enroll in this course during their 
undergraduate years, this sample is probably 
representative, in terms of intelligence and 
cultural background, of the more than 6000 
students who were enrolled at the school dur- 
ing that period and who, in turn, were mainly 
from the various sections of the state of Flor- 
ida. The ages of the subjects were not record- 
ed, but since almost all the students were in 
their sophomore year, it is probably safe to 
assume that few were above 22 or below 17 
years of age. The vast majority ranged ia uge 
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between 18 and 20 years. 


A booklet of four pages was prepared, two of 
the pages to be used for the drawings and the other 
two containing the 60 questions or statements of 
the Minnesota Multiphasic Personality Inventory 
Masculinity-Femininity Scale to which answers of 
“true” or “false” were to be given. The tests were 
administered by the junior author to the subjects 
in 16 groups of approximately 40 students each. 
When each subject had a booklet, the group was 
instructed as follows. “On the front page you are 
to draw a person. I am not interested in your abil- 
ity to draw, but rather in how you attempt to draw 
a person, Please do not turn the pages of the book- 
let until told to do so.” When all subjects had com- 
pleted the first drawing, they were further in- 
structed as follows. “Now turn to the next page. 
On this sheet you are to draw a person of the op- 
posite sex to the one you have just drawn. If you 
drew a male on the front page, draw a female 
here. If you drew a female, now draw a male.” 
When this drawing had been accomplished, the fol- 
lowing directions were given in the administration 
of the M-F Scale of the MMPI. “Please place the 
letter M for ‘male’ or the letter F for ‘fernale’ in 
accordance with your sex in the space provided at 
the top left-hand corner of the third page. Now 
circle T for ‘true’ and the letter F for ‘false’ ro 
these statements as they apply to you.” Invariably 
students questioned whether or not they should ap- 
pend their names to the booklets. They were told it 
was not necessary to do so unless they wished to. 
Mention was also made that their responses would 
in no way affect their grades in the course. 


Results 


Of the 185 males, 163 or 88.1 per cent drew 
their own sex first. Similarly, the majority of 
the female subjects drew their own sex first 
(252 or 65.3 per cent of 386), but the pro- 
portion was significantly lower (CR=6.7, 
giving a p which is less than .01). The SE’s of 
the percentages were relatively low in each 
case (2.40 for the males and 2.42 for the 
females), thus indicating that the occurrence 
of the self-sex drawings for both groups was 
beyond chance expectation. These results agree 
fairly closely with Holtzman’s report [3] 
showing that 85 per cent of the males (N= 


Table 1 
MMPI M-F Scale Scores for Subjects 


Subjects N Mean SD t $ 
Males 185 26.30 4.02 

a 29.6 001 
Females 336 37.26 450 


40) and 67.5 per cent of the females (N=40) 
drew their own sex as their first responses to 
the Draw-a-Person test. Generally, therefore, 
the sex sequence of the human-figure drawings 
differentiated the sexes on a group basis. 

The results of the MMPI M-F Scale were 
found also to separate the two sex groups as 
shown in Table 1. 

It should be noted, furthermore, that rela- 
tively little overlapping occurred between the 
distributions of the two sets of scores. 


Table 2 


Sex Sequence in the Draw-a-Person Test and 
MMPI M-F Scale Scores 


g 
a “Ss g 
ag 3 ° 3s 
2 £22 g BE = 9 
3 Om iu = OF u h 
= sg d a S$ d & 
2 ZO A a An a ao” 
Males 163 26.30 4.22 22 26.22 5.10 .07 
Females 252 37.64 4.16 134 36.67 4.90 .18 


‘The question now arises as to what relation- 
ship, if any, may exist between the incidence 
of self-sex drawings as a first response to the 
Draw-a-Person test and the ratings achieved 
on the M-F Scale. Calculation of the point 
biserial correlations for both sexes indicated 
that this relationship is probably of a zero 
order (r »™.009 for males and rpi==105 for 
females). A comparison of the M-F Scale 
means of the subjects of each sex who drew 
the same sex first with the means of those who 
drew the opposite sex first, as shown in Table 
2, further substantiated this. In addition, the 
differences between the mean M-F Scale scores 
of those drawing either of the sexes first were 
in the direction of the sex of the subjects 
rather than of the sex drawn first. Thus 4 
comparison of the scores of the males and fe- 
males drawing the male figure first yielded a £ 
of 19.9, showing a highly significant difference 
between the M-F Scale means. Similarly a ¢ of 
10.2 was obtained from the comparison of the 
M-F Scale scores of those subjects in both sex 
groups who drew the female figure first: 
Finally, a ż of 8.9 was found between the M- 
Scale scores of both sexes for those drawing 
the opposite sex figure first. 


Sex Sequence in the Draw-a-Person Test 


Discussion 


Evident from the data is the fact that both 
the Draw-a-Person test and the MMPI M-F 
Scale serve to differentiate the male and female 
groups quite definitively. Apparently the tend- 
ency to draw the same sex first, however, is 
far stronger in men than in women. In these 
findings the present study is in essential agree- 
ment with results reported by other investi- 
gators. Added only is the fact that what is 
found among young children [4] and adults 
[3, 5] is also clearly the case with older 
adolescents attending college. 

Not so clear, on the other hand, is the sig- 
nificance of the self- or opposite-sex drawings 
as the initial response to the Draw-a-Person 
test. Insofar as the MMPI M-F Scale is a 
measure of psychosexual identification, the 
data would tend to refute the hypothesis of 
Machover [6] and Buck [2] suggesting that 
sexual inversion may be involved in the choice 
of the opposite sex as the first response to the 
request of the examiner to “draw a person.” 

Normal cultural factors are probably among 
the important determinants of the trend noted 
in this and other reports for people to draw 
their own sex predominantly on the Draw-a- 
Person test. Those subjects who fail to follow 
the trend may, of course, be responding to 
different cultural influences, or to a variety 
Of internal stimuli, which lead to the associa- 
tion of opposite sex as their initial reaction. 
Empirically Machover [6] and Buck [2] have 
found reason to believe that one’s drawing of 
the human figure is essentially a self-portrait. 

ut this may not be as generally true as they 
cad one to suppose. It is logical to suppose 
that the sex of the person one is inclined to 

Taw as one’s first response to the Draw-a- 

erson test may be related to internal and ex- 
ternal stimuli far removed from psychosexual 
identification and self-portraiture. This is not 
to suggest, on the other hand, that in many 
Instances conscious or unconscious portrayal of 
one’s body image is not involved. eae 
Owever, is the need to investigate the fan- 
tasies and environmental factors affecting an 
individual at the time he is responding to the 


Taw-a-Person test. 
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Summary and Conclusions 


The Draw-a-Person test and the MMPI 
M-F Scale were administered to a group of 
185 male and 386 female college students 
taking the general psychology course. The sex 
of the figure drawn as the first response was 
noted in each instance and compared, in turn, 
with the scores made on the masculinity- 
femininity test. An analysis of the data yielded 
the following conclusions. 


1. Male and female college undergraduates 
tended to draw their own sex predominantly 
when directed to “draw a person.” The inci- 
dence of same-sex drawings was significantly 
greater among males than among females. 


2. The MMPI M-F Scale significantly 
differentiated between the male and female 
subjects. 


3. No relationship was found between the 
sex sequence of human figures drawn and 
scores on the masculinity-femininity measure. 
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A Note on the “Tree and Trauma” Interpretation 


in the HTP’ 


Murray Levine and Eugene H. Galanter* 


University 


In his manual Buck [1, p. 390] suggests 
that blemishes drawn on the tree, such as 
scars, knotholes, broken branches, points of 
unusual shading or reinforcement, or weak or 
dead branches, may be representative of trau- 
mata which have occurred in the life of the 
person making the dra wing. Furthermore 
he suggests [1, p. 340] that the ratio between 
the height of the traumatic indicator and the 
total height of the tree will yield the approx- 
imate age, plus or minus one year, of the oc- 
currence of the trauma. The suggested inter- 
pretation has practical importance in terms of 
diagnosis, and it also contains implications for 
the theory of projection in expressive tech- 
niques. Specifically it would mean that the tree 
drawing has some relationship to the self con- 
cept as the self concept is projected into a “life 
space.” It is then of considerable interest to 
treat the interpretative suggestion as an hy- 
pothesis and to attempt an objective verifica- 
tion of that hypothesis. 

The clinical evidence related to this sug- 
gestion is seemingly derived from the post hoc 
examination of the individual’s life history for 
incidents considered traumatic by the individ- 
ual. The interrogation of the subject involves 
suggesting the age of traumatic occurrence to 
him and his response is therefore not independ- 
ent of the indicator in the drawing. Further- 
more the criteria for a traumatic occurrence 
are not specified and any unusual occurrence 
mentioned by the subject is accepted as a valid 


TReviewed in the VA and published with the 
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“trauma.” An objective test of the validity of 
the interpretation requires that both the trau- 
ma and its date of occurrence be specified in- 
dependently of the drawing. 

The writers obtained drawings of a tree 
from 27 hospitalized, paraplegic veterans as- 
suming that the severity of the injury and the 
circumstances under which it occurred, as well 
as the complete reorientation to life the injury 
requires, make it eligible as a trauma. In ad- 
dition one can specify the exact date of occur 
rence of the trauma. Both the trauma and the 
time of occurrence are in this way specifie 
independently of the drawing. The instructions 
were simply “Draw a tree.” The population 
ranged in age from 18 to 40, the median age 
being 26 years and the duration of injury 
ranging from 6 months to 10 years, with 4 
median duration of 15 months. 

s on the 


The presence of traumatic indicator 
thors 


tree was independently rated by the au 
according to the general criteria stated 
Buck. The raters agreed as to presence or au 
sence of indicators in 82 per cent of the cases 
The degree of agreement is significantly grea 
er than chance agreement of 50 per cent: o 
the 27 drawings rated, only 7 contained Ur 
equivocal traumatic indicators. The fact that 
only a small percentage of this obviously iaw 
matized population drew indicators which cou i 
be reliably rated as such suggests that oe 
the hypothesis has dubious validity, pat 
other unknown personality factors contribut 
to the appearance or nonappearance of such ! 
dicators on tree drawings. The age °! > h o 
rence of the trauma was calculated in eac tu- 
these 7 drawings and compared with the a° a 
al age of traumata as obtained from the i 
tient’s records. The correspondence was ee 
None of the cases fell within the tworye 
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limit suggested by Buck. However, a rank- 
order correlation between the estimated age of 
occurrence obtained from the drawing and the 
actual age of occurrence obtained from hospi- 
tal records proved to be plus 73; significant 
for the 7 cases at approximately the .05 level 
of confidence. In addition to the few cases, 
confidence in the size of this coefficient is 
lessened by the presence of split ranks. These 
results, however, suggest that the hypothesis 
may have some degree of validity in terms of 
a broad approximation of the time of injury, 
but statements concerning more exact localiza- 
tion in time are not supported by our data. 
Since only a small percentage of this trau- 
matized population spontaneously drew trau- 
matic indicators, future research will require 
dealing with a very much larger parent popu- 
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lation in order to obtain sufficient cases to test 
the hypothesis adequately. Verification of the 
interpretation, even in the form suggested by 
the present results, would seem to have in- 
teresting theoretical consequences for the 
general concept of Projection in expressive 
techniques, and specifically for the notion that 
the self concept can be studied by this and 
similar methods. Others who may be working 
with similarly traumatized individuals might 
profitably repeat the study with 1 n 


; arger samp- 
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Ashby, W. Ross. Design for a brain. New York: 
John Wiley & Sons, 1952. Pp. ix + 260. $6.00. 


This is another excellent addition to the list of 
distinguished treatises on cerebral mechanisms that 
Wiley has been publishing. The problem that 
Ashby has set himself is “to deduce from the ob- 
served facts” what are the necessary properties of 
a nervous system that acts “at once mechanistically 
and adaptively.” The book is well written, the 
thesis clearly and tightly developed, and there is 
much more use of and integration with specific 
biological findings than one is apt to get in 
theoretical works of this sort. It remains, however, 
of necessity a difficult book which merits a larger 
audience than it will probably get. Its appeal will 
be greater to students of the logic of science and 
of system construction than it will be to practicing 
clinicians. The appendix contains a 50-page re- 


statement of the thesis in mathematical form.— 
W. A. H: 


Baumgarten, Franziska (Ed.) La psychotechnique 
dans le monde moderne. C, R. du 1X® Congres 
International de Psychotechnique. Paris: Presses 
Universitaires de France, 1952. Pp. xi + 630. 
2,000 fr. 


This is the report of the 9th International 
Congress of Psychotechnology held in Berne, Swit- 
zerland, in 1949, fifteen years after the last pre- 
vious Congress. In addition to the welcoming ad- 
dresses, and a report by the General Secretary of 
the preceding fifteen years of the work of the In- 
ternational Association of Psychotechnology, the vol- 
ume includes over 100 papers presented by persons 
representing 23 different countries. More than half 
of the papers are in French, the others are in Ger- 
man, English, or Italian. These papers are present- 
ed under fourteen topical headings representing a 
wide array of problems and applications. Although 
containing but few detailed research reports, the 
volume offers an unusual opportunity to become ac- 
quainted with the current thinking and practice 
of our colleagues in other lands. Only seven of the 
papers were by Americans!—E. L. K. 


Note.—The reviews were prepared by the Editor 


nd, the Associate Editors, who may be identified 
by their initials. 
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U. S. Federal Security Agency. Public Health Serv- 
ice. National Institute of Mental Health. Mental 
health and motion pictures. Publ. Hlth Serv. 
Publ. No. 218. Washington: U. S. Government 
Printing Office, 1952. Pp. 124. $.30. 


For anyone who has the responsibility of aa 
cizing or training in the various aspects: of jee 
health this guide to 106 films is a positive ne 
The films are grouped under Child and ee 
Marriage, Mental Health and Schools( for teach 
ers, and for students), Mental Health Problem 
Physiology of Human Reproduction, and Misse 
laneous. The synopses clearly present the descrip 
tion of the film, its aims, and other information 
pertinent to its use, The format is excellent, o~ 
running time, distributor, television informant 
followed by ample space for personal comments M 
the local viewer. The “Suggested Audiences S 5 
tains valuable information. Care has been take 
not only to state the audience for which the film 


presentation needs more careful controls, the type 
of control needed such as the presence of 
professional worker. ‘The book contains 
agencies designated as State Mental Health Av 
thorities, names and addresses of distributors, 
an excellent index.——B. M. L. 


Frosch, John. (Ed.) The annual survey of psych 
analysis. Vol. I, 1950. New York: aig’ 
Universities Press, 1952. Pp. xvi + 556. 

50, all 


“This is the psychoanalytic literature of se new 


of it... ” With this opening statement, was 
survey venture in psychoanalytic literature to 
launched. Apparently other annual surveys all the 
follow. The publication aims at abstracting a 
periodical literature of the field k af 
books for a given year; it does not aim at 
reviews. Eleven of the twelve chapters | the 14 
matically with articles in the field, while plished 
chapter abstracts 12 of the 42 books ect or- 
during the year 1950. Some idea of the su Je ti- 
ganization can be gained from several chap Child 
tles: History, Methodology, Clinical Studies scho- 
Analysis, Psychoanalytic Therapy, Applied, as ab” 
analysis, etc. Many contributors are liste? * 
stractors, and most of the chapters have 
authors. The job done in this survey 15 tre 
but even more important is the quality of m 
the abstracts. Comparing the abstracts w r the 
of the complete articles creates great respect 40 


— 
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compilers of this publication. Not infrequently is 
an article improved in readability and clarity by 
the abbreviation; writers in the psychoanalytic field 
are not as a rule adherents of the Law of Parsi- 
mony. The Annual Survey of Psychoanalysis is a 
welcome addition to psychological and psychiatric 
literature. Psychoanalysis will probably win more 
friends and more understanding through this vol- 
ume than through the original material it attempts 
to abstract—M. K. 


Hirsh, Ira J. The measurement of hearing. New 
York: McGraw-Hill, 1952. Pp. ix + 364. $6.00. 


The fields of experimental psychology and clinical 
audiometry are nicely integrated in this comprehen- 
sive and useful book on hearing. The introductory 
chapters give enough background on psychophysics, 
the physics of sound, and electroacoustic devices to 
serve the needs of readers who have at least a mini- 
mum acquaintance with the physiology and psy- 
chology of audition, The major problems taken up 
in the remaining chapters include the measurement 
of the hearing of pure tones and of speech, masking, 
fatigue, differential sensitivity, binaural hearing, 
bone conduction, and the use of conditioned re- 
sponse methods in audiometry. Because hearing loss 
is often related to a person’s broader social adjust- 
ments, clinical psychologists have good reason to 
maintain more than a casual acquaintance with 
audiometry. They will find Hirsh’s book an excel- 
lent resource.—L, F. S. 


Kornitzer, Margaret. Child adoption in the mod- 
ern world. New York: Philosophical Library, 
1952. Pp. xiii ++ 403. $4.50. 


The greater part of this book, written by the press 
officer of a group of British adoption societies, con- 
cerns present practices with detailed description of 
legal procedures in Great Britain. There is also 
some routine discussion of adoption problems gen- 
erally, selection of adoptive parents, telling the 
child, the unadoptable child, and so on. Adoption 
first became legal in Great Britain in 1926; in 1949, 
seventeen thousand adoption orders were made. 
About one-third of the book discusses adoptive prac- 
tices in other parts of the British Commonwealth, 
and brief reference is made to the situation in other 
countries. Two chapters are devoted to the United 
States. These summarize the legal situation in the 
various states and give some over-all comparison 
with that in Great Britain, but contain chiefly a 
“mosaic of brief quotations . . . because only in 
this way is it possible for a British writer to pre- 
sent, primarily for British readers and without 
causing offence to American ones anything like a 
valid picture of what goes on in the American 


adoption field today.” —A. R. 


Kuhlen, Raymond G., & Thompson, George G. 
(Eds.) Psychological studies of human develop- 


ment. New York: Appleton-Century-Crofts, 1952. 
Pp. xiii + 532. $3.50. 


Currently, source books for introductory courses 
in psychology are finding their way into the class- 
room in increasing numbers. This paper-bound vol- 
ume is a collection of 71 abridged and edited pri- 
mary source materials in the general area of devel- 
opmental psychology—here , defined as extending 
from infancy through senescence. The subject mat- 
ter covered includes physical factors in develop- 
ment, learning, intellectual development, social-cul- 
tural conditions, interest patterns, vocational orien- 
tation, and personal-emotional adjustment. The pa- 
pers, originally published between 1928 and 1951, 
represent not only different research areas, but dif- 
ferent methodologies, with the result that the stud- 
ies selected will be considered of uneven quality by 
many readers. Although many studies now consid- 
ered “classics” are included (e.g., Gesell, Jones & 
Conrad, Terman, Hartshorne & May, and Levy), it 
is inevitable that most readers will find some of 
their particular favorites missing. Although in gen- 
eral the abridgment and editing are done with care, 
it is questionable whether some of the more exten- 
sive abbreviations are wise (as, the reduction of 
Levy’s book, Maternal Over protection, to eight 
pages). These problems intrinsic to source books, 
however, should not detract importantly from the 
usefulness of this volume as a teaching aid in intro- 
ductory courses in developmental psychology.—4. M. 


Wolfle, Dael. (Chairman) Improving undergrad- 


uate instruction in psychology. New York: Mac- 
millan Company, 1952. Pp. vii + 60. $1.25. 


This is a 60-page report of a study group which 
attacked the problems of the objectives and the 
curriculum of undergraduate 


instruction in psy- 
chology. The members of the committee are well 
known and respected by their colleagues and the 


report will carry weight. A recommended curricu- 
lum with core, special interest, advanced, and inte- 
grative courses is presented for the typical liberal 
arts undergraduate. It is frankly a psych 
content-centered curriculum rather than 
or problem-oriented one. The educational objectives 
of personal growth and social adjustment are con- 
sidered but rejected in favor of knowledge, habits 
of thought, and attitudes and values. The report 
states further that “it is probably desirable to 
avoid direct frontal efforts to modify student’s 
habits and attitudes.” Little space is given to indi- 
rect and student-centered means of dealing with 
attitudes and values that do not employ the meth- 
ods the committee rightly banned such as “pres- 
sure,” disregard for student rights, or reformation. 
Although a traditional and conservative education- 
al climate pervades the report, there is an occasion- 
al hint that in committee discussion the realities of 
student motivation, individual differences, aa 
present societal needs occasionally arose, The pub- 


ology- or 
a student- 
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lished report, however, does not seem to give much 
significance to these influential factors which will 
determine how well their educational objectives 
can be met. This report can render a real service 
if it provokes debate and research on both the po- 
tential role of psychology in a liberal education and 
the means by which this can be realistically ac- 
complished with our present student body. It will 
serve also as a target of attack for those who feel 
along with this reviewer that the psychologist has 
a special responsibility and competency adroitly to 
assist students to meet their personal and social 
needs, and who also maintain that this is a pri- 


mary educational goal and basic to a liberal educa- 
tion—F, McK. 


Tests 


Bennett, George K., Seashore, Harold G., & Wes- 
man, Alexander G. Differential Aptitude Tests. 


Manual (2nd Ed.), pp. 77 ($2.00). New York: 
Psychological Corp., 1952. 


The Differential Aptitude Tests have been pro- 
vided with an entirely new manual which replaces 
the original loose-leaf edition of 1947 and its five 
supplements issued between 1948 and 1951. In 
addition to the inevitable directions for administra- 
tion, scoring, and use, the new manual contains 
unusually comprehensive data about the tests. Norms 
are now based on groups of 2100 to 7400 for Form 
A, and of 350 to 1075 for Form B, for each sex and 
for each grade from 8 to 12, separately. The va- 
lidity of the DAT is described in terms of its pre- 
diction of subsequent course grades, achievement 
test scores, and postschool careers. There are about 
20 pages of tables of validity coefficients. Also pre- 
sented with more than minimum adequacy are re- 
liabilities, standard errors of measurement, and the 
intercorrelations of the tests. Even more detailed re- 


New Books and Tests 


search data have been deposited with the Ameri- 
can Documentation Institute so as to be available 
to technically trained users. The Manual can serve 
as model for other test constructors, and as an ad- 
junctive text for courses in measurement.—-L. F. S. 


Books Received 


Adler, Leta M., Coddington, James W., & Stewart, 
Donald D. Mental illness in Washington County, 
Arkansas: Incidence, recovery, and posthospital 
adjustment. Little Rock, Ark.: Univer. of Arkan- 
sas, 1952. Pp. 74. 

Brennan, Robert E. General psychology. (Rev- Ed.) 
New York: Macmillan, 1952. Pp. xxxii + 524+ 
$5.50. 


Coombs, Clyde H. 4 theory of psychological scal- 
ing. Engng Res. Bull. No. 34. Ann Arbor, Mich.: 
Univer. of Michigan, 1952. Pp. vi -+ 94. $1.75. a 

Eisler, Robert. Man into wolf, an anthropologica 
interpretation of sadism, masochism, and lycan- 
thropy. New York: Philosophical Libfary, eee 
Pp. 286. $6.00. . j 

Lindner, Robert. Prescription for rebellion. New 
York: Rinehart, 1952. Pp. 305. $2.75. N 

Maslow, Paul. Powers of the mind. Brooklyn, N. 
Y. (16 Court St.): Author, 1952. Pp. 288. $3.50. 

Meerloo, Joost A. M. Conversation and dammu 
cation, a psychological inquiry into language ane 
human relations. New York: International Uni- 
versities Press, 1952, Pp. x + 245. $4.00. 

Palmer, Harold. The philosophy of psychiatry. go 
York: Philosophical Library, 1952. Pp. ix + 7 
$2.75. m 

Powys, John Cowper. The inmates. New York: 
Philosophical Library, 1952. Pp. 318. $4.50. m 

Helping parents understand the exceptional child. 
Proc. Annu. Conf. Educ. Except. Child. Lang- 
horne, Pa.: The Woods Schools, 1952. Pp. 42- 
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Rigidity ad Shock Therapy of Psychotics: 


An Experimental Study 


Maxwell S. Pullen 


Ohio University 


and Ross Stagner 


Convulsive shock therapy has, in a little more 


» ‘ee dacade, become a major tool in the psy- 


eatment of mental disorders. Particu- 

r those psychotics who are inaccessible 

àotherapy, it has become practically a 

prescription in many hospitals. Yet it 

<o exaggeration to say that today we 

elatively little about its actual behav- 

cts (outside of amnesia) ; and certain- 

tve no generally accepted theory as to 

erlying processes involved. Psycholo- 

psychiatrists urgently need a single 

formulation which will clearly relate the symp- 

toms and dynamic structure of the individual 

patient to the effects of shock therapy, if this 
is to be used with maximum efficiency. 

One such formulation is that shock therapy 
modifies rigidity among psychotics [see, e.g., 
Billig and Sullivan, 1]. This implies (a) that 
rigidity is a major component of the psychotic 
syndrome, and (b) that one effect of shock 
therapy is to change this component. To verify 
this hypothesis or disprove it, we shall need 
agreement as to the meaning of rigidity, and a 
good measure of its extent before and after 
treatment. 

The notion that psychotics, especially schizo- 
phrenics, are unusually “rigid” has consider- 
able appeal. The schizophrenic is likely to 
show stereotyped behavior, inability to change 
when the situation calls for change. His be- 
liefs are set and resistant to logic. It is difficult 
to get him to “see things differently.” How- 
ever, when we look at the experimental litera- 
ture on the measurement of rigidity, we en- 


. Counter complications. There are marked dif- 


ferences of opinion as to whether rigidity is a 
unitary phenomenon, and even whether “rigid” 


University of Illinois 


behavior as defined by the experimenter fits the 
psychotic syndrome just described. 

Since the literature has recently been an- 
alyzed by Cattell [2], Cattell and Tiner [3], 
Fisher [4], Luchins [6], Rokeach [8], and 
others, we shall not attempt another survey. 
Some of the conclusions offered by Fisher will 
be accepted as a starting point for a description 
of our specific research design: 


1. In an intellectually homogeneous group, in- 
dividual differences in rigidity exist. 

2. Individuals with organic pathology are more 
rigid than individuals without such pathology. 

3. Certain kinds of schizophrenics seem to be 
more rigid than other kinds. 

4. Isolated persons seem to be more rigid than 
non-isolated persons who are otherwise comparable. 

5. When different kinds 
applied to the same group, 
differences in the 
measures, 


of rigidity measures are 
there frequently are real 
results given by the various 


On the basis of our study of the literature 
on rigidity and on shock therapy, we concluded 
that there was ample justification for a study 
designed to test the hypothesis that convulsive 
shock therapy is followed by a reduction in the 
rigidity of the patient’s behavior. 


Method 


The factor-analytic studies of Cattell and 
others indicate that there may be more than 
one kind of rigidity. Certainly there are differ- 
ing definitions of the phenomenon. At the out- 
set, therefore, we elected to define rigidity as 
“a generalized tendency to cling to or persey- 
erate with a previously-made response, in lieu 
of switching to a response which is more ap- 
propriate to the prevailing experimental con- 
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ditions.” The choice of tests was then made in 
conformity with this definition, guided also by 
the general intelligence level and cooperative- 
ness of our proposed subjects. 


We have adopted four tests from the bat- 
tery used by Cattell and his students. One of 
these is a motor test (creative effort), while 
three are perceptual (hidden objects; riddles; 
and flicker fusion threshold). One test was 
borrowed from V. W. Grant (hidden words). 
Four new tests were devised for the study: 
changing colors; changing figures; changing 
pictures; and flicker fusion overlap. Also used 
in the battery was the Short Form Wechsler- 
Bellevue scale. The following brief descrip- 
tions identify each test: 

1. Changing colors: one set of 20 cards varied 
by minute gradations from a saturated red to a 
Saturated orange, and another set of 26 cards varied 
from blue to green. The subject saw the cards 
within a black exposure box, uniformly illuminated, 
and presented in series. He was told that the color 
would change, but that he was simply to name each 
color as he saw it, Each § did four runs, 


each direction with each set of cards, 
was the amount of 3 i 


one in 


Thus, he 
“orange” on card 
at card twelve. The 
bly signifies rigidity 


20 cards ranged from a 
e to a perfect circle; and 


perfect square to a four- 
pointed star. Measure as in test 1, 


subject writes “ready” nor- 
mally, for one minute; then writes the same word 
in reverse Script, for one minute. Next he writes 
"agg normally and in reverse; and then his own 


normally and in reverse, Score 


x), in which x is the number of 


letters normally and y the number in reverse stroke. 
(Adapted from Cattell.) 


*All testing was done individually by Mr. Pullen, 
e wish t 


to thank the administration (Dr. O. D. 
Timm, Chief of Professional Services, Dr. L. A. 
Pennington, Chief Psychologist, and Dr, 


-> Manager) at the Danville VA Hospital for 
ir Cooperation on this study, 


5. Hidden objects: five mimeographed pean 
pictures. Score is number of hidden objects located 
in one minute per picture (Cattell). a 

6. Hidden words: Subject is shown a card ae 
the letters: WILLOW L EA F as marinka: 
He is shown that the underscored letters giente 
name of an animal. After two more pon 
samples, he is given the test of 12 unmarked ame 
at the rate of 30 seconds per card. The score te 
the number of animal names located within t 
time limit.2 


7. Riddles: after a few samples to be sure w 
S understands, he is given 12 riddles, each es ed. 
solved within 30 seconds. Score: number se 

8. Flicker fusion threshold: § was patie a 
adapted with dark goggles during the ridd e ‘a 
He is now asked to look into a black a? A 
at a square of milk-glass, behind whic “a He 
Strobotac, set at 3700 RPM. E then poe oes 
Strobotac down until S observes flicker, A Fai 
all the way down to 600 RPM, then back. ane 
mean ading of 8 ascending and 8 epee 
terminations of threshold (not ingluding jong P 
tice run each way). Low fusion threshold is ass 
to indicate rigidity, 


p Ker 
9. Flicker fusion overlap: the mean of ed is 
Ported thresholds for the § “descending” T ding” 
subtracted from the mean for the 8 A t 
runs, on the hypothesis that clinging to the P 
once established indicates rigidity. hension, 
10. The weighted scores on Compr a je- 
Arithmetic, and Similarities of the yeeo for 
vue were added to give an intelligence meas 
inclusion in the battery. 


Subjects 


y 35 

The Experimental Group consisted sos 
Psychotic patients from the Danville ¥ onvul- 
pital who were designated to FEceIve ) 
sive shock therapy (electric or insulin atien 
Control Group included 25 psychotic se os 
from the Danville VA Hospital ; it was he for 
to be similar to the Experimentals ors diag: 
lowing respects: (a) average age; ( 


can O 
$ k å ration 
nostic categories represented; (c) du ) 


: ‘tation; 
illness; (4) degree of ging ee by 
amount of preshock rigidity, as mea 
t 
our battery, d no 
g . ste! 
Each experimental subject was te 


A hoc 
earlier than 72 hours prior to his hours 
treatment, and again, not later than ol sub” 
after his last shock treatment. Copi Jate! 
jects were tested as they were chosen, a port” 

?We wish to thank Dr. V. W. Grant, Harissi° 
den State Hospital, Macedonia, Ohio, for P 
to use this test, 
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Table 1 è 
Intertest Correlations 
Test 2 4 6 7 8 9 10 
1. Changing colors 59 31 41 —.15 -.03 —.01 —.01 
2. Changing figures 25 -.38 =.23 = 15 -.07 -17 
4. Creative effort -.32 ~32 —.09 ~.06 04 
5. Hidden objects 65 37 06 22 
6. Hidden words Fri 28 50 
7. Riddles 1S 54 
8. Flicker fusion threshold ‘a0 
9. Flicker fusion overlap 27 
10. Wechsler-Bellevue 
retested at such intervals as to make the test- Table 3 
retest interval comparable for the two groups. Rotated Factor Loadings 
Statistical Analysis Test Factor* 
i H I’ r2 re h? 
Our first purpose was to establish a com- 
posite single score for preshock rigidity for 1 18 ar 61 m 62 
each patient. To achieve this we proceeded as i nS S pi P T 
follows: the nine tests in the battery were in- 5 <46 79 te ea oe 
tercorrelated (Pearson r) to give the matrix 6 ~22 87 ‘05 96 or 
4 z i ; i 6 
shown in Table 1. (The “changing pictures” 7 ~.04 139 00 79 79 
8 -.06 20 00 04 04 
9 18 —.56 03, Fea 35 
Table 2 10 -.08 52 01 27 28 
Reference Factor Loadings * I’: “Rigidity.” 
Test PaRa Il’: “Intelligence.” 
I II 2 Ir? h? 
R 49 a z = A a We next proceeded to compute z scores for 
2 -53 A 28 36 54 individual subjects on the rigidity factor. This 
4 oan a pr ‘o4 .16 Was done as follows: Thurstone has pointed 
5 80 119 64 204 68 out that FP = § where S is the matrix of in- 
6 77 AL 59 7 -76 dividual z scores on the several tests, F is the 
= = om a a factor matrix, and P is the matrix of individ- 
9 -s1 -24 26 ig a ual z scores on the factors involved. Since we 
10 43 30 ‘18 ‘09 37 know F and S, we can find 


test, Test 3, was dropped from the statistical 
analysis because on retest virtually every con- 
trol subject recognized it immediately and 
made the switch purely on a memory basis.) 
All 60 subjects (experimental and control ) 
were used for these correlations. 


A Thurstone centroid factor analysis was 
made of Table 1. Two factors emerged, which 
upon rotation were identified as a “rigidity” 
factor and an “intelligence” factor (Tables 2 
and 3 and Fig. 1). Heavily loaded for rigidity 
were Tests 1 and 2, with 4 having a moderate 
Positive loading, 5 moderate negative, 


d P by premultiply- 
ing both sides of Thurstone’s equation by 


GEE) — aF? £10, p. 68], from which we get: 
Pi = (FF) — F’. 

This enables us to compute factor scores for 
each subject on Factor I’ and IS 

It is now necessary to obtain change scores 


based on the variation in rigidity from the first 


to second testing. We obtained these by first 
solving the equation: 


Since the above equation a: 
factors, 
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-100 -90 -80 -70 -60 -50 -40 -30 -20 “0 


-100 
Fig 1. Original and rotated axes, 


P= (FF) — 198, 


in which the same F matrix was used, but 
where S, was computed as follows: each §’s 
Taw score on the second testing was converted 
into the z score he would have obtained had 
each distribution retained its same mean and 
sigma as on the first administration, We in- 
terpret these as absolute measures of rigidity 
based on the Same scale units derived in matrix 
1. 


Having determined 
score fi 


N 
o 
\ 
ea 


ferred t° 
score on the original testing will be rete 
as the R score. 


Results 


Our principal interest is in the effect of ae 
therapy in reducing rigidity in the Expe” ‘ 
tal as compared with the Control oe 
Table 4 shows, the mean D score for : ing 
mentals was —.76, Controls —.53, eset 
net difference in favor of the Experimen a 
0.23 z-score points. Thus both groups cree 
decline in rigidity, the Experimentals | difer 
ing more. The confidence level for this or dS 
ence is between .15 and .20; in other W ie rt 
we cannot reject the null hypothesis and 4 


hock 
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Table + 


Group Comparisons of D-score Means* 
(total sample) 


tote 
Group & Mean = 25 

D Score ~ ge Se ze 

zZz WA» 3 aH 
Experimen- Control 

tal (all) (all) 
~716 —.53 .23 .24 98 58 .20>p>.15 
Experi- Control 
mental (all) 

(improved) 5 
—.96 —.53 .43 .24 1.83 47 .05>p>.025 
Experi- Experi- 
mental mental 
(im- (unim- 
proved) proved) 

—.96 —.34 .62 .45 1.36 33 .10œp>.05 


*D scores are differences in rigidity factor scores 
(R scores) from Administration I to Administration II 
of test battery. 

tOne-tailed test. 


that the shock therapy has significantly reduced 
rigidity, although the trend is in that direc- 
tion. 


If we reject from the Experimentals those 
patients rated as unimproved by the psychia- 
trists after shock, the mean D score obtained 
is significant at a confidence level between .025 
and .05. The improved and unimproved Ex- 
perimentals differ by a quantity approaching 
significance (confidence level between .05 and 
.10). 

The above findings are virtually repeated if 
we limit our sample to schizophrenics.* The 
only interesting change in confidence levels is 
that the Experimental improved vs. unim- 
proved comparison is now highly significant. 

Significance of original R score. Despite the 
fact that the differences in mean D score con- 
sistently favor the group receiving shock, and 
that this difference is statistically significant 
for those patients rated as improved, there may 
be variables other than shock which could ac- 
count for the finding. One of these is size of 
original rigidity score. 

There is a correlation of —.45 between R 
score and D score for the total group. This 
means that, in general, those who were low on 
rigidity at the beginning have tended to in- 

“This involves the elimination of only five cases. 


Data are not reproduced here, but can be found in 
full in Pullen [7]. 


crease, or those who were high to decrease in 
score. However, when the Experimenta] and 
Control groups are treated separately, we find 
that this is true only within the Experimental 
group (r = —.49), not in the Controls (r = 
—.08). Thus it cannot be simply a manifesta- 
tion of the general tendency to regress toward 
the mean on retesting. 

It is also possible to show that the differ- 
ences are not due to differences between groups 
in original R score. Table 5 shows that the 
Experimentals and Controls differ only at the 
third decimal place on R score mean, and the 
Experimental Improved were actually a shade 
more rigid on initial testing than the unim- 
proved fraction. None of these differences even 
approach significance. 


Table 5 


Group Comparisons of R-score Means* 
(total sample) 


Group & Mean 
R Score 


Diff. 
Level of 
Signif.+ 


Net 


Experimen- Control 
tal (all) (all) 


-002 —.004 .01 .28 02 58 .95>p>.90 
Experi- Control 
mental (all) 
(improved) 

-07 «00 07 .31 .23 47 0>p>.80 
Experi- Experi- 
mental mental 

(im- (unim- 
proved) proved) 

07 —14 0.21.47) 45 433 -70>p>.60 


*R scores are scores on the rigidity factor on first 
administration of the battery. 


tTwo-tailed test. 


Were the Controls more severely disturbed 
than the Experimentals prior to shock? Each 
patient was rated for degree of incapacitation 
just prior to the first testing. Table 6 shows 
that none of the differences between groups 
in degree of disturbance approached signifi- 
cance. It is, however, interesting to note that 
there was a slight (not significant) tendency 
for the severely disturbed group to make high- 
er R scores than those less disturbed. In view 
of the data shown in Tables 5 and 6, it is clear 
that this has not contributed spuriously to the 
findings on the effect of shock therapy. 
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Table 6 EN 
Distribution of “Degree of Incapacitation 
hi (DOI) Variable 


Groups Compared 
Improved 
Experimental Improved experimental 
with control experimental _ With 
with control unimproved 
experimental 


Value of 
chi square 43 1.08 1.16 = 
Level of 
confidence .50>p>.30 35>p>.25 30>p>.20 


Specific tests. The data have also been com- 
pared for each of the nine tests in the final 
battery. Of these, tests 1, 2, and 5 (chang- 
ing colors, changing figures, and hidden ob- 
jects) most clearly show decrease in rigidity 
after shock. Tests 6, 7, and 9 (hidden words, 
riddles, and flicker fusion overlap) show some 
confirming differences. Tests 4 and 8 (motor 
reversal and flicker fusion threshold) contra- 
dicted the trend; shock cases made smaller 
changes away from rigidity than did the con- 
trols, and the Improved cases made smaller 
changes than the Unimproved. 

Intelligence. 


Of incidental interest may be 
our finding th 


at intelligence was not signifi- 
cantly affected by shock. As other studies have 
shown, our Experimentals showed a slight de- 
cline in Wechsler-Bellevue Score, but it is par- 
ticularly interesting to find that the Improved 
group declined less than the Unimproved shock 
cases. None of the differences approach sig- 
nificance, 

Discussion 


We feel that our results justify the follow- 
ing generalizations: (a) rigidity, defined as 
the tendency to persist in a Previously made 
response, in the face of changing conditions 
which render the Tesponse inappropriate, is a 
generalized factor, manifest in a variety of 
different test situations ; (b) rigidity, so de- 
fined, is decreased by shock therapy; and (c) 
Persons classified as improved show more de- 
Crease in rigidity than patients classified as un- 
Improved after shock therapy. However, we do 
not find, either in our own data or in the liter- 
ature, a satisfactory Suggestion as to the nature 
of the basic mechanism involved, 

ecause of the fairly obvious resemblance of 
Our rigidity measures to the familiar negative 


transfer (proactive inhibition) experiment, = 
interpretation in terms of habit ireren 4 
inviting. The fact that our best measures, e 
of rigidity and of change, were perceptua llel 
character tempts us to speculate on a pane h 
phenomenon of perceptual interference. A 
such approach seems somewhat inadequa d 
however, because it ignores the aaa id 
character of the phenomenon. We are not ae 
ing here with a simple case in which habit ⁄ ‘ 
interferes with habit Y; instead, we have in 
dividual M showing, in a variety of situations, 
more interference than individual N. i 
As a tentative interpretation we offer a 
following speculations regarding the rigid r E 
sonality, Every individual can be conceiveé Ta 
developing certain systems, perceptual and oe 
havioral, which protect his essential oor 
equilibria [Stagner, 9]. The normal person 
ity is characterized by perceptual systems = 
alertness to changing stimuli, and peponi a 
quences oriented to these external stimuli. 2A 
other Personalities, alert perception of aa 
may not have led to maintenance of equili 
rium ; relatively greater reinforcement may 
have followed from ignoring the chang e 
stimulus, and plugging away with an invariant 
response. Could we describe the rigid pero 
ality as one which has learned to protect ioner 
equilibrium by blocking out awareness of ai 
changes in the external world? This wou 
certainly fit some of our schizophrenics! of 
S Soon as we start defining extremes ee 
these response tendencies, however, we ie 
aware that normal people show some rig! al 
havior, and few rigid individuals refuse Pd 
pletely to observe and adapt to change. ay 
Person with a clear-cut reality orientation ar 
still, at times, withdraw and ignore the m 
world, attending presumably to inner eee 
and Correspondingly, even the withdré a 
schizophrenic can be induced to respond peel A 
ternal stimuli if they are sufficiently deme 
ing. : ah a 
This suggests that we are dealing on 
balance of two complex response systems, ae 
being developed to some extent in ay ane 
sonality. Let us label as System R the a are 
of perceptual and response tendencies whic sat 
closely oriented to reality. These are tk a 
Satisfying, tension-reducing activities whic ead 
volve a need to attend to changing exte 
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stimuli and to modify responses in an appro- 
priate manner. Now let us label as System W 
the system of perceptual and response tenden- 
cies which are oriented away from the external 
stimulus. These likewise are activities which 
have served to satisfy motives, to reduce rela- 
tive tension or to avoid increase of tension. 
Each of us feels a need, at times, to get away 
from painful reality. Fantasy is only one of the 
many devices by which we block responses to 
the present external world. 

We propose, in brief, that all individuals 
develop both System R and System IV, but 
that the relative balance of the two varies 
widely. The alert, reality-oriented extrovert 
has learned a predominance of R patterns; 
these have led to a maximum of reinforcement 
in his experience. The resistant, uncooperative, 
rigid schizoid has not found satisfaction in R- 
type responses; on the contrary, his motives 
have been channeled into withdrawing, ignor- 
ing, avoiding patterns. Obviously, under pres- 
sure the X system can be pushed aside and the 
R system activated; or, with the R system sa- 
tiated, J responses may dominate the organ- 
ism. It would be predicted that the extent of 
learning of such systems would determine the 
relative rigidity of each personality. 

In the situation presented by our rigidity 
test battery, the patient no doubt would have 
preferred to continue his M system activities 
(autisms, fantasies). If, however, the W needs 
are relatively satiated, or if R stimuli of con- 
siderable magnitude are present, it is possible to 
activate the R system. Under pressure from the 
experimenter, the patient will look at the card, 
name the color, etc. The R stimulus has ex- 
ceeded the threshold value needed for effective 
competition with the W system. However, the 
R needs satiate readily, the strong W needs 
take over, and he attempts to withdraw from 
the situation. If the experimenter continues to 
press for a response, the patient is likely to re- 
peat his preceding response; this is available 
with little energy required, and it serves as a 
tension reducer by getting rid of the pressure 
from the experimenter. Thus, the schizophrenic 
tests “rigid” not because he is incapable of 
perceiving the stimulus and changing his re- 
sponse, but because he has adopted a different 
device for maintaining equilibrium. As the 
situation looks to him, the easiest way to keep 


the experimenter at arm’s length and thus con- 
tinue with preferred autistic responses, “is to 
keep giving a response once found acceptable. 

Why, then, does the schizophrenic change 
his response at all? Eventually, we assume, the 
growing discrepancy between the stimulus he 
is receiving and the response he makes reaches 
a threshold value; i.e., while he ignores a minor 
degree of “inappropriateness,’’ a major dis- 
crepancy is potent enough to block out the //7 
system and reinstate the R system. As the ex- 
periments on distraction have shown, we shut 
out disturbing external stimuli by channeling 
more energy into the on-going response system. 
However, even a highly motivated habit pat- 
tern can be disrupted if the external stimulus 
becomes sufficiently intense. 

Does such an interpretation of personality 
rigidity help in the understanding of shock 
therapy? We believe that it does. Here we 
rely particularly upon the amnesic effects of 
shock. The Æ system of the schizophrenic is 
composed of percepts, autistic habits, fantasies, 
and avoidance behaviors of fairly recent origin. 
His R system, of observing external events, 
obeying verbal instructions, and responding to 
changes in the field, was laid down earlier in 
childhood. Shock, by inducing amnesia for the 
stronger but later habits, “uncovers” the R 
system and frees it from interference. Further, 
by disorganizing the fantasy world, shock may 
make it less attractive, so that potential grati- 
fications in the real world seem more desirable. 

Essentially, then, we are suggesting that 
shock therapy modifies rigidity by its effects 
on memory. In a more precise way, we would 
say that rigidity is a complex form of percep- 
tual interference and habit interference, based 
upon generalized response systems. Learned 
motive patterns support one system oriented to 
reality, to changing stimuli, to demands of 
society, and another system involving responses 
of withdrawal, fantasy and avoidance of social 
requirements. Rigidity develops as the latter 
responses increasingly interfere with the for- 
mer; and rigidity decreases when an event, 
such as shock therapy, breaks up the withdraw- 


‘al habit patterns and thus eliminates interfer- 


ences with earlier, reality-oriented responses, 


Summary 


1. We have defined rigidity as «ne tendency 
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to persist in a previously made response, in lieu 
of switching to one which is more appropriate 
to the stimulus situation. 

2. Factor analysis confirms the view that 
rigidity as defined is a generalized feature of 
psychotic personalities. 

3. Convulsive shock therapy produces a de- 
crease in rigidity scores as defined; this de- 
crease approaches statistical significance for the 
total group, and meets criteria of significance 
for those shock cases rated as improved. 

4. The differences cannot be imputed to 
differences between experimental and control 
subjects in degree of original rigidity, or in 
degree of disturbance prior to treatment. 

5. An interpretation is offered in terms of 
motivation to maintain equilibrium by respond- 
ing alertly to reality, or by withdrawing from 
it. The amnesia induced by shock may break 
up habit systems based on the withdrawal 

nate habit interfer- 
n the earlier reality 
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A Specitic Relapse Phenomenon During the 
Course of Electric Convulsive Therapy’ 


Roderick W. Pugh 


Veterans Administration Hospital, Hines, Illinois 


This article is the report of one group of 
findings resulting from an exploratory, de- 
scriptive investigation of certain psychological 
processes during courses of concurrent electric 
convulsive therapy and nondirective psycho- 
therapy with paranoid schizophrenia [1]. 
These findings pertain to a specifically local- 
ized relapse in charted improvement, followed 
by recovery, which occurred during the courses 
of treatment. 


Problem and Procedure 


The problem was to chart the course of 
certain psychological processes, and to deter- 
mine the significance of any measurable 
changes in them throughout the treatment 
periods. The psychological processes involved 
were defined by eighteen categories of verbal 
expressions. Fourteen of these consisted of 
expression of attitudes or feelings and were 
designated “affective” categories. Four cate- 
gories were positive, negative, objective, and 
ambivalent attitudes towards the self; four 
were positive, negative, objective, and am- 
bivalent attitudes towards others; two were 
positive and negative attitudes perceived as 
directed towards the self from others; and 
four consisted of the summation of positive, 
negative, objective, and ambivalent attitudes 
towards the self and others. The four remain- 
ing categories of the eighteen were designated 
“nonaffective.’ They were: “Statement of 
problem or symptom,” “Understanding or in- 


1From VA Hospital, Hines, Illinois. Reviewed in 
the Veterans Administration and published with the 
approval of the Chief Medical Director. The state- 
ments and conclusions published by the author are 
the result of his own study and do not necessarily 


reflect the opinion or policy of the Veterans Ad- 
ministration, 
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sight,” “Discussion of plans,” and 
statements or verbalization.” 

The investigative procedure called for a 
patient’s receiving sixteen electric convulsive 
treatments at the rate of three per week, and 
ten nondirective interviews approximately one 
hour in length. The convulsive treatments and 
interviews ran concurrently. The sequence 
began with an interview, and thereafter an 
interview was held twenty-four hours or later 
after every second treatment until the sixteen 
convulsive treatments and nine interviews 
were completed. At this point two weeks were 
allowed for recovery from possible 
effects of the convulsi 
tenth and final interview was held. The 
median number of days required for the entire 
procedure was 56.5, 

The interviews were electrically recorded 
and later transcribed into verbatim typescript. 
They were then analyzed on the basis of the 
eighteen categories of verbal expressions listed 
above so that trends followed by the psycho- 
logical processes represented could be deter- 
mined. This method of interview analysis 
yielded reliability coefficients between analysts 
of .88, significant at the .001 level of confi- 
dence.? The significance of variations in trends 
was derived by the statistical method of deter- 
mining the significance of the difference be- 
tween proportions as applied to successive pro- 
Portions of interviews represented by a partic- 
ular category. This same Procedure was ap- 
plied to groups of interviews representing the 
initial (interviews 1 to 3), middle (inter- 


“Trrational 


“organic” 
ve therapy. Then the 


?Additional measures of over-all ch 
tained by comparing before and a 
from the Rorschach, MMPI, and 
Completion Test. These results do 
the findings under consideration her 


ange were ob- 
fter test data 
Stein Sentence 
not feature in 
e, howevzr, 
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views 4 to 7), and final (interviews 8 to 10) 
stages of the treatment procedure. 


Subjects 


The subjects were six World War II 
veterans drawn three each from two Veterans 
Administration hospitals in the Chicago area. 
They were selected by the criteria of a diag- 
nosis of paranoid schizophrenia by two psy- 
chiatrists, an achievement of a T score of 59 
or above on both the Paranoia and Schizo- 
phrenia scales of the Minnesota Multiphasic 
Personality Inventory, and the selection of 
electric convulsive therapy as a somatic treat- 
ment. They ranged in age from 24 to 35 years. 
The duration of their illness could not be 
precisely determined, but since all had served 
actively in the last world war, it is probable 
that none had been acutely affected for longer 
than five years prior to study. All were re- 
ceiving their first course of electric convulsive 
therapy and none had previous exposure to 
psychotherapy. 


a Positive references to others 
Negative references to others 


Ss 


PERCENT OF TOTAL RESPONSES IN THE INTERVIEW 
a 


2 3 4 5 


The Relapse Phenomenon 


‘Trends followed by the psychological pro- 
cesses in each patient over the entire treat- 
ment course predominately represented thera- 
peutic gain. Seventy to 100 per cent of the 
statistically significant’ changes recorded for 
each patient were so characterized. For the 
six patients as a group, 61 per cent of the 
categories (11 of 18) demonstrated signifi- 
cant and therapeutically directed change. | Lhe 
remainder showed no statistically significant 
changes. Greatest therapeutic gains were rep- 
resented by decreased statements of problems 
or symptoms, and decrement in negative feel- 
ings and attitudes, especially of total negative 
feelings expressed and negative feelings t07 
wards the self and towards others. 

During the course of treatment, however, 
reversals in trends indicative of negative thera- 
peutic movement, and constituting @ relapse 
in a general course of improvement, were O 


Ce: cer) + ] or 
3Criterion for significance is at the .05 leve 


less. 


6 7 


INTERVIEWS 


each interview for the six subjects as a group. 


Fig. : 4 
E 1. Average per cent of responses in Categories of positive and negative reference’ 


s to others 


na Ji 
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INTERVIEWS 
Fig. 2. Per cent of responses in categories of total positive feelin 


pressed in each interview by Subject 4. 
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gs and total negative feelings ex- 


lo Perceived feelings of others towards the self 
= Positive 
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PERCENT OF TOTAL RESPONSES IN THE INTERVIEW 
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INTERVIEWS ne 
Fig. 3. Per cent of responses in categories of “ 


perceived feelings of others towa: 
Pressed in each interview by Subject 1. Pilte sep 
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served to occur specifically between the tenth 
and twelfth electric convulsive treatments and 
during the period covered by the sixth and 
seventh therapeutic interviews. The observed 
reactions were most characteristic of the affec- 
tive categories, with negative feelings in- 
creased and positive feelings decreased. The 
strongest and most consistent reversals oc- 
curred in “Negative references to others” and 
in total negative feelings. Of almost equal 
strength and consistency were reversals in 
“Positive references to others” and in total 
Positive feelings (Fig. 1, 2, and 3). Oc- 
casionally the reaction was demonstrated by 
decreased ability to make objective appraisal 
and by increased perception of negative atti- 
tudes directed towards the self from others. 
Some of the nonaffective categories in which 
the relapse phenomenon appeared in instances 
were “Statements of problems or symptoms” 
and “Irrational statements or verbalization.” 
Interestingly, Personal attitudes and feelings 
toward the self exhibited the greatest relative 
stability during the period. It should be 
Pointed out here that the relapse phenomena 
were made prominent in graphical records 
because of early and almost immediate re- 
covery of the previous therapeutic course of 
movement. 

The relapse was marked in two of the six 
patients by clinically prominent changes in 
behavior such as increase in delusional mate- 
rial, acting-out of hostility and aggression to- 
wards others, viole 
therapy, 


or on the part of one 
cular which caused the 
more closely the thera- 
others for the same 


Discussion 


_ The fact that psychiatric treatment is 
characterized p 


-2 OY exacerbations, whether the 
treatment is somatic or psychotherapeutic, is 


not new knowledge. The curves of all 18 
categories for each of these patients ii 
irregular at other periods as well as at a 
period in question. The importance F t e 
present observations lies in the fact that 
qualitatively similar and a particularly ape" 
inent relapse, as revealed by the methods c 

this investigation, fell at a specific locus in 
treatment time for each of these six patients; 
in spite of the fact that the patients perenni 
in the same phase of treatment at the gane 
time and that they were treated at two ha 
rate hospitals. Similar data are not nown, 
exist on any other group, nor is the — 
gator aware of any reported clinical ead 
tions which have so narrowly localized =. 
a phenomenon. Each of the subjects denoi. 
strated the relapse in from 5 to 11 of the = 
categories. Throughout the group there yer 
47 reversals in trends recorded during t 3 
time. Of these, 59.57 per cent were statistica 

ly significant. 


Although this study was not controlled a 
Partial out the individual effects of the ae 
sive therapy and the psychotherapy," o- 
seems to be little reason to doubt that the foi 
Matic treatment was largely responsible s 
the reactions. Since the patients were stu en 
at different times and were divided betwee 
two different hospital environments, it is one 
unlikely, excluding the factor of the wt sy- 
convulsive treatment, that even the same is 
chotherapist or that psychotherapy itself Trh 
elicit such regularly occurring reactions ith- 
six different personalities. However, 1t 15 ft? 
in the realm of tenable speculation that Sy 
trolled electrical stimulation to organ c 
similar brain tissue could produce a speje 
physiological response from the tissue prê 
table with respect to time of occurrence. 

The exact type of physiological re 
which might be involved is unknown ts 
simplest terms, however, it is possible t™ 
while electric convulsive therapy has 4 e the 
rative effects, because of its drastic eat ae 
attendant stress reaches a critical an ni 
intensity at a certain point which is suffici 


action 


mello” 


re per 
*Psychotherapeutic sessions in this study ag psy” 
marily intended as an avenue for investiga ag such; 
chological processes rather than there ae an 
hus, to minimize the direction of thin mtilizee" 
behavior, a nondirective type interview was 


disruptive of cerebral physiology and metabo- 
lism that prior therapeutic gains are momen- 
tarily nullified by a relapse attendant to the 
onset of the disruption. The organism reacts, 
however, by mustering all its physiological de- 
fenses to counteract this state of affairs, just 
as the body reacts to all states of shock. This 
rallying of defenses would then coincide with 
the recovery from the relapse. It is hypothe- 
sized that the duration of the recovery is de- 
pendent upon two factors: (a) the duration 
and intensity of continued stress stimulation, 
and (4) the inherent strength of the organism 
to withstand further such excesses. 

The findings for these six subjects are clear. 
The nature of the study, however, precludes 
broader generalizations at present. Should 
further research substantiate the existence 
of a specifically localized relapse in courses of 
electric convulsive therapy of ten or more 
treatments with paranoid schizophrenia or 
other diagnoses, definite implications with 
respect to the efficacy of longer courses of 
treatment are involved. Present findings sug- 
gest that future research might be directed 
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towards investigating these 


additional hy- 
potheses : 


1. That the basic reaction of the relapse 
phenomenon is physiological. 


2. That the stronger and more pervasive 


the relapse, the less favorable the psychological 
prognosis. 


3. That the strength of the relapse is a posi- 
tive correlate of the relative severity of the 
basic psychological pathology. 

4. That more effective results with electric 
convulsive therapy are achieved if, at the rate 
of three treatments per week, there is suffi- 
cient interruption in time after every ninth 
administration to allow for physiological re- 
covery from the stress of the therapy. 


Received August 11, 1952. 
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Psychological Changes Following Operations on 
the Human Frontal Lobe’ 


Sidney Crown 
Institute of Psychiatry (Maudsley Hospital), London 


In a previous paper, Crown [2] reviewed 
studies of psychological changes following pre- 
frontal leucotomy, the majority of which had 
appeared before 1949. The clinical follow-up 
studies discussed in that review almost invari- 
ably reported personality changes to follow the 
operation. These changes, however, were usu- 
ally expressed in terms which are difficult or 
impossible to define and measure such as ap- 
athy, lack of spontaneity, fatuous equanimity, 
absence of finer emotional response, etc. 


In order to clarify the field, it was essen- 
tial that an attempt should be made to express 
the changes taking place after operation in 
terms of carefully defined, quantitative hy- 
potheses which could be clearly confirmed or 
rejected. In the present state of knowledge, 
such hypotheses would inevitably ignore the 
complexity and subtlety of the changes which 
take place within any individual patient, for 
it would be necessary to concentrate, at first, 
on broad changes detectable over a group of 
persons. As in all scientific work, however, 
this initial oversimplification is justifiable if it 


leads at a later stage to more detaile 


d experi- 
mental work. 


Eysenck [5] has attempted experimentally 
to establish some of the dimensions or direc- 
tions along which human personalities vary, 
and to define these dimensions 
In terms of 
light of re 
tual schem 
leucotomy. 


1I am very grateful to Mrs. $ 
carried out a considerable part of the testing for 
and 


this research to Dr. H, J. Eysenck for reading 
and criticizing the manuscript. 


ybil Eysenck who 


therefore, carried out by Petrie, whose ye 
were summarized recently by her [13], and by 
the present author [4]. P 
Petrie has worked primarily with neurons 
patients. She demonstrated [11] that in ts 
rotics the personality changes three mont n 
after operation take place along three brga? 
dimensions: in the intellectual sphere, — 
was a decrease in intelligence as shown ow 
ticularly on the Wechsler verbal scale and t B 
Porteus Maze test. Of the nonintellectual pa 
sonality changes, there was a decrease a i 
conative or characterological factor that A 
senck [5] has called “neuroticism” or A 
tional stability ; this was shown by a significar $ 
decrease in body-sway suggestibility and E 
ported by changes on certain other object! A 
tests and indices. The third main change TP a 
temperamental one, from the introvert to t 2 
extravert end of the introvert-extravert peel 
tinuum. This temperamental factor is = 
which Eysenck [5] defines in terms of t¢ ae 
which differentiate the dysthymic group of a 
tients (anxious, depressed, obsessional) ot 
the hysterics. In Petrie’s study the shift on t 
factor after leucotomy was shown by gang 
such as loss of persistence in a situation invo by 
ing an uncomfortable physical position, & el 
ency on several tests to go for speed rat ase 
than accuracy, a lowering of the level of ae 
Piration, more realistic judgment of perfor 
ance, and reduced motor perseveration. hi 
confirmed these findings in a retest nine mon 
after operation [10], and in a later paper [ the 
showed that after less severe operations di 
nonintellectual changes were in the same es 
rection but were less pronounced, and chang 
in intelligence were not detectable at all. he- 
Crown [4] investigated the same hypot m 
ses in a group of patients the majority of who 
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were psychotic. There were few statistically 
significant changes in this group following the 
operation, although the direction of the 
changes was consistent with decreases in in- 
telligence and neuroticism. It was not possible 
to demonstrate a consistent change towards 
extraversion in the psychotic patients. 

That the hypotheses were clearly confirmed 
on neurotic and not psychotic patients is un- 
derstandable in the light of later research on 
the “psychoticism” factor. In a recent study, 
Eysenck [6] confirmed the hypothesis that the 
functional psychoses (schizophrenia and manic 
depressive insanity) are not qualitatively dif- 
ferent from normal mental states but form one 
extreme of a continuum which goes all the 
way from the perfectly normal, rational, to 
the completely insane, psychotic individual. 
This personality dimension, “psychoticism,” is 
relatively uncorrelated with neuroticism or 
with introversion-extraversion, Psychotic pa- 
tients, such as those tested by Crown [4], are 
not persons who are especially high in their 
position either on the neuroticism or the in- 
troversion dimensions and would not be ex- 
pected to show changes along these dimensions 
comparable in size to those made by neurotics. 
Further, as has been pointed out [7], cognitive 
processes have not yet been linked up prop- 
erly with psychoticism so that it is difficult to 
predict changes in intelligence for psychotic 
subjects after leucotomy on the basis of Ey- 
senck’s dimensional system. In the psychotic 
field, as Eysenck [7] further suggests, the 
main prediction would be that after leucotomy 
there would be a shift along the psychoticism 
axis in the direction of greater normality. A 
test of this hypothesis is the main interest of 
the present investigation. 

More tests of the “‘psychoticism” factor 
than of the other factors are included in the 
present battery. On the factor of introversion- 
extraversion, on which little work has as yet 
been completed following up that reported by 
Eysenck [5],? only a “marker” test (persis- 
tence) is included to demonstrate the shift on 
this factor. On the whole, tests have been in- 
cluded in the present battery only if enough 


2For the reader interested in the nature of intro- 
version-extraversion, it may be stated that several 
follow-up researches are at present being carried out 
in this department. 
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knowledge has been accumulated about them 
to place them fairly accurately as meastires of 
a given factor. Experimental tests and tests 
whose position is, as yet, ambiguous because 
of equal saturations with more than one fac- 
tor (e.g., Abstractions, cf. Eysenck [7]) have 
not been used. 

Unfortunately, the present group contains 
both psychotic and neurotic patients. Also 
both full and limited operations have been 
performed. From the considerations cited ear- 
lier in this section then, it may be suggested 
that although the decreases in intelligence, neu- 
roticism, introversion, and psychoticism should 
take place, these changes may be somewhat at- 
tenuated. If, however, the personalities of per- 
sons after prefrontal leucotomies or ablations 
can be shown to change measurably along pre- 
cisely defined psychological dimensions, a use- 
ful preliminary aim will have been accom- 
plished. The time will then be appropriate to 
attempt specific experimental studies in the 
neurosurgical field. 


Organization of the Research 


When the research was begun, it was antici- 
pated that the patients to be operated upon 
would fall into three broad clinical groups: a 
group operated upon for the relief of obses- 
sional illness, tension, agitation and depression, 
a schizophrenic group, and a group of patients 
suffering from intractable pain. Three types 
of cerebral operation were to be carried out: 
open prefrontal leucotomy [15], topectomy 
[14] and cortical undercutting [18]. As there 
is no adequate comparative evidence on the 
merits of these different types of operation, if, 
after careful consideration, it was considered 
that a patient may benefit from a cerebral 
operation, this was assigned to him from the 
three operations under investigation on a ran- 
dom basis. The system of randomization was 
such that each operation would be assigned an 
equal number of times within each broad clin- 
ical group. Patients considered by hospital 
physicians as possibly suitable for neurosurgi- 
cal treatment were presented at a clinical con- 
ference and the decision for or against opera- 
tion made by two senior psychiatrists and by 
the surgeon. In almost all cases this decision 
was made by the same set of persons, 


94 Sidney Crown 


At the present time (18 months after the 
start uf the project) 15 patients have been 
operated upon and 13 of these have been fol- 
lowed up for at least 3 months. From the psy- 
chologist’s point of view, of these 13 patients, 
4 were untestable: 3 were too ill to cooperate 
and 1 took an early postoperative discharge. 
Of the remaining 9 patients, 2 could not be 
tested on a large number of the present tests, 
as these patients had been tested earlier in their 
stay in hospital on tests which were so similar 
as to invalidate testing on the present battery. 


This report, therefore, is concerned with 7 
patients who were tested before, and approxi- 
mately 3 months after, operation. Six of the 
patients were woman. The age range of the 
whole group was from 29 years to 53 years 
with a mean age of 40 years. The IQ range 
of the 6 patients who successfully completed 
the Progressive Matrices test (Raven) was 
from under 89 to 126+ with a mean of 108 
points (approximately). Three of the group 
were suffering from severe obsessive-compul- 
sive illnesses and four from severe depressive 
illnesses with marked tension. Three and pos- 
sibly four of these patients were suffering from 
illnesses of a degree of severity which must, 
clinically and socially, be considered as “Dsy- 
chotic.” Three, the obsessive-compulsive ill- 
nesses, following normal clinical practice, must 
be considered as “neurotic.” 


Three of the seven patients had an open 
prefrontal leucotomy, three a topectomy, and 
one a cortical undercutting. This unequal dis- 
tribution of the various types of operation de- 
spite the over-all system of assigning operations 
on a statistically random basis is the result of 
selecting the seven patients in the present 
group, for reasons specified earlier, from the 
total number of patients operated upon to date. 
In the present group this meant that four out 
of the seven patients had an operation of lim- 
ited severity. On the evidence of Petrie [12] 
the effect of the limited operation is to modify 
the severity of the postoperative personality 


changes. These should still, however, be in the 
hypothesized directions. 


This figure is approximate because the most and 


the least intelligent members of the group were out- 
side the test norms, 


Method of Analysis 

Lord’s [9] modified ¢ test* was used to test 
the significance of the differences between the 
scores on each test before and after operation. 
Taking each test separately the score of each 
person is compared before and after operation 
and a difference (D) column is calculated. The 
hypothesis to be tested is that the mean of the 
D column is significantly different from zero- 
In Lord's modified t test the test of signifi- 
cance is based on the use of the sample range 
rather than the sample standard deviation. This 
significance test is slightly less efficient than 
the more usual ¢ test. It is, however, consider- 
ably easier to compute and, where the number 
of tests in an investigation is large and 
number of persons tested small, is a usefu 
significance test. 


Table 1 


. + A igence 
Pre- and Postoperative Test Results: Intellige ’ 
Neuroticism and Introversion-Extraversion 


M M p 
TA 7 s 
Test N re Post 


Intelligence 
1. PorteusMazes 6 93.3 


2. Shipley-Hartford NS 
Abstractions 7 8.6 9.3 3.0 


3. Mill Hill 


90.5 30.0 NS 


NS 
Vocabulary 5 18.6 18.0 5.6 
4. Opposites: NS 
Selection 5 166 18.0 17 0.01 
Creation 5 16.2 148 0.9 
Neuroticism 
5. Word Connexion NS 
List 7 13.3 123 7.0 
6. Maudsley 
Medical NS 
Questionnaire 7 19.9 14.4 8.1 NS 
7. Perseveration 4 1.77 1.54 0.7 
8. Body Sway: NS 
Static ataxia 6 38.8 51.0 53.7 
Sug- NS 
gestibility 5 +63.2 +193.0 516.3 
Introversion- 
Extraversion NS 
9. Leg persistence 7 148.0 92.3 158.3 


is 
41 am indebted to Mr. A. S. C. Ehrenberg, of f 
Institute, for bringing the method to my atten A 
and for his advice on other statistical aspec 
this paper. 


| 
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Results 


The test results are given in Tables 1 and 
2. In each of these tables the following legend 
applies: N = the number of pairs of scores ;° 
M Pre = preoperative mean score; M Post = 
postoperative mean score; s = an estimate of 
the standard deviation of the D column (both 
this estimate and the tests of significance are 
based on the sample range instead of the sam- 
ple standard deviation, cf. [9]); ¢ = level 
of significance (as a definite hypothesis was 
investigated in every case, the one-tailed test 
was used, cf. Jones [8]). 

In the paragraphs below are given brief de- 
scriptions of the tests and methods of scoring. 
The numbers of the paragraphs correspond to 
those in the first column of the tables. Fur- 
ther details of these or similar procedures may 
be obtained from the references quoted or di- 
rectly from the present writer. 


Annotation to Table 1. 


1. Porteus Mazes [16]. Procedure as detailed by 
Porteus. Score: Test Quotient. 


2. Shipley-Hartford Abstractions [19]. A short 
reasoning test, the items of which are steeply grad- 
ed in difficulty. Score: number of items correct. 

3. Mill Hill Vocabulary [17]. A vocabulary test 
of the synonyms type. Alternate forms given before 
and after operation. Score: number of items correct. 

4. Opposites [1]. The two alternate forms of 
Cattell’s opposites tests were used, the first form to 
be administered in the usual way and then the alter- 
nate form to be administered without giving the S$ 
the usual choice of answers but making him supply 
his own answers without help. The first test is in- 
tended as a “selection” test, the second as a “cre- 
ation” test. Both tests were administered without 
time limit. Scores: number of items correct in each 
case. 

5. Word Connexion List [3]. A controlled asso- 
ciation test in which each item consists of a stimu- 
lus word and two possible response words, one of 
which is an “abnormal” response, the other a “nor- 
mal” response. Score: number of “abnormal” choices 
underlined. 

6. Maudsley Medical Questionnaire [5]. This 
test consists of questions dealing largely with physi- 
cal complaints such as are frequently made by neu- 
rotic subjects; a few psychological questions are 


5For practical reasons it was not always possible 
to test or to score all the subjects on every test. 


®This principle is a fairly common one in the de- 
sign of high-level intelligence tests. The particular 
test used in the present investigation is based on 
a suggestion of Dr. H. J. Eysenck. 


also included. Score: number of symptoms shown. 

7. Perseveration [6]. The S is required to write 
a series of Ss for 15 seconds (Period A), then a 
series of Ss reversed for 15 seconds (Period B) fol- 


Table 2 


Pre- and Postoperative Test Results: Psychoticism 


£ , M M 
Test N Pre Posi ‘ p 
1. Fluency: 
Birds 7 OF 99 1.5 NS 
Animals 7 104 13.1 is <0.01 
Flowers 7 126 144 3.3 NS 
Total 7 327 374 44 0.02 
2. Mirror Drawing: 
1st Trial 7 165.7 80.6 66.2 0.01 
2nd Trial 7 88.3 52.4 44.7 0.05 
3rd Trial 7 65.6 41.1 45.9 NS 
3. Circles: 
Time 7 20.3 20.4 20.0 NS 
Largest 
Diameter 7 40.6 42.7 11.1 NS 
Smallest 
Diameter 7 35.0 36.0 15.5 NS 
Average 
Diameter 7 37.9 39:3 10.4 NS 
4. Squares: 
Time 7 30.1 23.9 26.6 NS 
Largest 
Diagonal 7 45.3 47.3 14.8 NS 
Smallest 
Diagonal 7 41.1 384 10.4 NS 
Average 
Diagonal '7 43.4 42.9 9.6 NS 
5. Reading Prose 7 22.9 213 3.0 NS 
6. Estimating 
distances: 
Overestimation 
3 tests 7 2.6 19 63 NS 
Underestimation 
3 tests 7 211 13.0 15.5 NS 
Error 8” estimate 7 4.7 2.7 44 NS 
Error 1’ estimate 7 6.4 4.0 5.9 NS 
Error 2’ estimate 7 12.6 8.1 6.7 NS 
Total error 7 237 14.9 15.2 NS 
7. Waves: 
Amplitude 4 245 225 24 NS 
Wavelength 4 116.2 90.0 15.5 0.02 
8. Tapping 7 57.6 66.2 16.6 NS 
9. Reversal of 
perspective: 
Passive 6 3.3 43 2:2 NS 
Active 6 8.2 6.8 7.5 N3 
Inhibited 6 2.5 3.0 28° NS 


Sidney Crown 
96 


lowed by a 30-second period (Period C) in which 
he writes alternately one S followed by an § re- 
versed. Score: A + BIC. . 

8. Body Sway [5]. From a string attached to 
the collar a continuous record is made on a kymo- 
graph of the S’s forward and backward sway dur- 
ing (a) a 30-second period when he is told simply 
to stand quite still with his eyes closed (static 
ataxia); and (b) a 2'/,-minute period when he is 
given continuous suggestion by gramophone record 
that he is falling forward. The kymograph records 
are scored graphically using a grill of -inch 
squares drawn on tracing paper to estimate the 
amount of movement, i.e., the area under the curves. 
Scores: Static ataxia: total forward sway (number 
of Y%-inch squares) + backward sway. Suggesti- 
bility: total forward sway or total backward sway 
whichever is the greater,? 

9. Leg persistence [5]. The S, sitting, holds his 
g out horizontally over a chair of the same height 
for as long as he can without touching down. Score: 
time in seconds, 

Annotation to Table 2. 


The reference for all the tests of Table 2 is 
Eysenck [6]. 

1. Fluency. Number of birds, animals, and flow- 
ers the S can name, one minute for each. 

2. Mirror Drawing. The S is required, 
only in the mirror, to trace round a diamon 
the corners of which are indicated on the p 
dots. Three trials. Score: time (seconds). 

3. Circles. The S was handed 
paper and asked to draw thre 
in Table 2: time in seconds, measures in mm. 

4. Squares. The paper with the circles on was 
reversed and the § asked to draw three squares on 
the other side. Scoring as in Table 2: time in sec- 
onds, measures in mm. 

5. Reading Prose. The S was asked to read 
aloud a standard piece of prose. 
onds, 


6. Estimating Distances. The S is asked to in- 
dicate what he considered 2 feet distance was by 


placing two matches two feet apart on the table; 


then one foot; then 8 inches, so that there are four 
matches on 


the table. These distances are measured 


le 


looking 
d shape 
aper by 


a clean piece of 
e circles. Scoring as 


Score: time in sec- 


e kymographic method of 


1 ore and the scoring prob- 
lems raised by this method h 


tematically tackled. In partic 


tively. This is consistent with a 


0 ondly, the quantitati 
(in this study i 


It is hoped to 


ve scoring units 


r ed by a given amount of kymograph- 
1€ movement has been investigated. 


and recorded. Scoring as in Table 2: quarter-inch 
units. 

7. Waves. A sheet of foolscap size, squared pa- 
per with + J's marked at precise places is given t 
the S. In each of 4 trials the § is required, i 
with the eyes open, to trace over a V; then, wit 
eyes closed, to make six more P's along the same 
line and, as far as possible, the same e. The au 
is kept up all the while, only the pencil — 
the paper. Two scores were derived: amplitu . 
(average of Ist and last amplitude of 4 sets E 
waves, i.e, of 8 measures altogether); and Bi Al 
length (average wavelength of all + sets measure 
parallel to edge of the paper). Measure in m, m 

8. Tapping. Tapping with a pencil on re ge 
of paper for two trials of 15 seconds each. co Ši 
Average number of taps made. Instruction is not i 
tap as fast as possible; score, therefore, represents 
natural tempo rather than maximum rate. Ali 

9. Reversal of perspective. Necker Cube. 5 
sion explained to S. Scores: (a) passive, Ten aaa 
age number of fluctuations during two 30 i hé 
periods, the one period at the beginning an ei 
other at the end of the test. (b) Active, ies nu 
ber of fluctuations recorded for 30 seconds a ai 
is asked to make illusion change as fast as poss! ied 
(c) Inhibited, ie, number of changes puerta 
during 30 seconds when S$ is asked to try and p 
vent the cube from changing. 


Discussion 


As the hypotheses investigated are pae 
in the following discussion importance 1S il 
tached both to changes which are statistica y 
significant at or less than the 10 per cent lege 
and to groups of changes which, although, 5 
dividually insignificant, are in the hypothesize 
direction. 

Considering first changes in intelligenc® 
5 scores were derived from the intelligenc? 
tests. Of these, the changes in 4 are insign! m 
cant and their direction is inconsistent: P 
formance is improved slightly postoperative 
in the Shipley-Hartford Abstractions test i 
in the selection of opposites and is diminis i 
on the Porteus Mazes and the selection 
synonyms (Mill Hill Vocabulary). 


There is, however, one particularly 1n a 
esting change on the “Creation” test, one in- 
the few experimental tests in the battery $s 
cluded in an attempt to measure changes 5 
some of the higher intellectual function: 
After a cerebral operation the group were @ 
fected to a significant degree in their a 
to think out without help a word opposite te 
meaning to a stimulus word, although on t 


ter- 
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“Selection” test, using words of a parallel de- 
gree of difficulty, they show themselves to be 
unaffected or even improved slightly in the 
power to select the correct opposite from a 
number of choices. Not enough persons were 
examined to make a serious quantitative analy- 


of errors worth while. However, consider- 
ing the records of the 3 persons in the group 
whose scores on the “Creation” test dropped 
most postoperatively, the errors appeared to be 
of two types. In the first type an opposite of 
inferior stringency was given after operation 
compared with that given before, e.g., patient 
A.M. “Brave” is the opposite of “cowardly” 
(preoperatively), “stupid” (postoperatively) ; 
patient A.W.S. “all” is the opposite of “none” 
(preoperatively), “a few” (postoperatively). 
The second type of inferior response occurred 
when the § made no real effort to find an op- 
posite, e.g., patient H.E.L. “Brave” is the op- 
posite of “coward” (preoperatively), “not 
brave” (postoperatively) ; or “save” is the op- 
posite of “spend” (preoperatively), “not save” 
(postoperatively). 

Thus although the results of the usual in- 
telligence tests—performance (Porteus), rea- 
soning (Shipley) and verbal (Mill Hill Vo- 
cabulary, selection of opposites)—showed no 
impairment, the results from the “Creation” 
test do suggest that high-level intellectual 
changes may take place after neurosurgical 
operations. 

Petrie [12], using the Wechsler-Bellevue 
vocabulary and other verbal tests, has also re- 
ported that her patients show carelessness in 
the use of language after leucotomy and she 
suggests that these intellectual changes may be 
more characteristic of the posterior operations. 
In the present small series of 5 cases tested 
on this test, of three patients who showed the 
greatest postoperative deficit on the creation of 
opposites test, two had the open prefrontal 
leucotomy, the most severe of the operations 
carried out in our series. 

It is difficult to determine how far such 
changes are a “true” intellectual deficit and 
how far they are secondary to changes of a 
nonintellectual type such as in the will or mo- 
tivation to work or carelessness at work. This 
is the difficulty which Petrie [13] also came 
UP against in attempting to explain her find- 
Ings. She provides no convincing evidence for 


deciding whether the change is a “true” in- 
tellectual change or not, and in the present 
experiment it is equally impossible to do this. 

On the tests of neuroticism, none of the 
changes is significant but the majority are in 
the hypothesized direction. The group score 
less abnormally on the Word Connexion List, 
on the Maudsley Medical Questionnaire, and 
lower on the test of Perseveration. Only on 
the Body Sway test are the scores in the 
wrong direction for the hypothesis. There is, 
however, considerable variability in individual 
performance on both the tests of Static Ataxia 
and Suggestibility after operation as the sta- 
tistics quoted in the previous section show. 
Larger numbers are needed to determine with 
any confidence whether the changes in score 
on this test are truly inconsistent or whether 
a more definite change in one direction or an- 
other may be discerned. Further, as stated 
earlier, falls were not taken into account in 
the present scoring although the greater pre- 
operative occurrence of this phenomenon is as 
expected. On the whole, then, the results show 
a discriminable but attenuated shift in the 
scores of the group towards the normal end 
of the normality-neuroticism continuum. On 
a mixed group of neurotic and psychotic pa- 
tients this result is what, as stated earlier, 
would be expected. 

A single “marker” test, Leg Persistence, 
was included to check the tendency of the 
group to move towards the extraverted end of 
the introversion-extraversion personality di- 
mension. As with the tests of neuroticism, only 
a slight decrease in score on this test would be 
hypothesized in a mixed neurotic and psychotic 
group. Thus the observed, but nonsignificant 
decrease in leg persistence is as expected. i 

Of the 28 scores derived from the tests of 
the psychoticism factor, 21 are in the direction 
which would be hypothesized if the scores of 
the group are becoming more typical of the 
normal than the psychotic person, and of these 
5 are statistically significant. The simple bi- 
nomial test shows that the occurrence of 21 
out of 28 changes in the hypothesized direc- 
tion is significant (i.e., would not be accounted 
for by chance) assuming that each of the 
scores is independent. This is not so, however, 
as several scores are often derived from the 


same test. Accordingly, this siguificance test 
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must be interpreted with caution. If it had 
been insignificant, the data would hardly have 
been worth considering further. Being signifi- 
cant, but under these limiting conditions, the 
results may be regarded as at least suggestive. 


If Eysenck’s [6] paper, in which he has 
demonstrated some of the personality traits 
which distinguish the normal from the psy- 
chotic person at a high statistical level of con- 
fidence, is taken as the basis for our hypotheses, 
then the shift towards normality on the psy- 
choticism factor is shown clearly on all the 
tests included in the present battery except the 
Drawing Circles test. The shift is shown es- 
pecially well on the Fluency tests, the Mirror 
Drawing test, and the Waves test. Thus, 
after leucotomy the group becomes more flu- 
ent, performs better on the Mir 
test, increases the rate of oscillation on the 
Reversal of Perspective test, makes smaller 
movements on the Squares and Waves tests, 
shows a lesser tendency to overestimate dis- 
tances and reads and taps more quickly. De- 
spite the small numbers and the fact that the 
group includes both neurotic and psychotic pa- 
tients, these changes support the hypothesis of 
a decrease on the Psychoticism factor fairly 
convincingly. 

On the whole, ther 
the hypotheses. With 
psychotic group, 
ited and greater severity have 
out, attenuated bu 
changes take pla 
level, intellectua 
tion there 
sonality fa 


Sion, neuroticism, and Psychoticism which are 
measurable at least on a group basis. A de- 
tailed exploration of the factors underlying 


hese road personality cha: g 
t b nges should now be 


ror Drawing 


Objective tests 


were used to measure some 
the Personality 


changes taking place after 


operations on the frontal lobe. 

In terms of tests used to define these fac- 
tors, it was hypothesized that, postoperatively, 
patients would tend to show a decrease in in- 
telligence, a temperamental change from intro- 
version towards extraversion and charactero- 
logical changes towards normality on the neu- 
roticism and psychoticism dimensions. 

Despite the small numbers studied, the 1n- 
clusion of both neurotic and psychotic patients, 
and operations of different degrees of severity, 
the data tend ‘to confirm these hypotheses. j 

So far as this is possible, attempts shoul 
now be made to study the mechanisms under- 
lying these observed personality changes. 
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Generalization of Problem-Solving Rigidity’ 


Emory L. Cowen,’ Morton Wiener, and Judith Hess 


University of Rochester 


Problem-solving or Einstellung rigidity has 
been defined as the tendency to adhere to an 
induced behavior when it ceases to represent 
the most direct path to a goal [4]. Consider- 
able research interest has surrounded this 
phenomenon in recent years, both in terms of 
its basic parameters and alleged personality 
correlates. With respect to certain aspects of 
the problem, there appears to be considerable 
agreement amongst the findings of independ- 
ent researchers to date. Thus for example, 
starting with the classic studies of Luchins 
[8] in 1942, the susceptibility of Einstellung 
figidity to a variety of specifiable field condi- 
tions now appears to be firmly established. 

Perhaps the single issue in this general area 
of research about which agreement is most 
lacking is whether or not this type of be- 
havioral rigidity bears relationship to other 
personality variables. That such a relation- 
ship may exist is implied in the work of the 
California group [1, 6], particularly that 
of Rokeach [10], as well as in the studies 
of Cowen and Thompson [4], Fisher [5], 
and Harway [7]. Luchins in his critique of 
Rokeach’s work [9] takes an opposite view- 
point stating that “rigidity is not a function 
of the Personality per se, but of particular 
field conditions,” 

In the present experiment 
this problem, we have started 
vation that when all pertine’ 


al approach to 
with the obser- 


nt variables are 
*Portions of this research were presented in a pa- 
Per read to the Division of Personality and Social 
Psychology, American Psychological Association, 
ashington, D. Cy September, 1952. 
?This inve 


controlled (i.e, intelligence, age, etc.) ani 
under a constant set of field conditions, in¢! 
vidual differences in rigidity of response gone 
tinue to be manifested. If, with the ane 
sary controls exercised, it can be demonstrate 

that this state of affairs is not solely a aie 
tion of specific task attitudes (i.e. ae 
arithmetical problems in the case of the wate d 
jar technique), we shall be able to “a 
greater credence to the existence of me 
concept of a personality-related mode of pr 


i >r q given 
lem-solving behavior — at least under a g 
set of field conditions. 
a y «these 
Phe research problem, viewed in t 


: F r lear- 
terms, becomes a relatively simple and € i 
Z e . » steps? 

cut one which may be described in two stel 


l. To develop additional measures of m 
lem-solving rigidity which are eh 
similar to the water-jar technique, but whi 
tap different areas of functioning. 


ill be 


2. To test the hypothesis that there W 


dye A sà -egy be 
@ positive relationship between rigidity 
haviors as measured by the several tasks- 

Procedures and Results j 

cot- 


Subjects in the present study were 37 ales. 
lege undergraduates, 30 females and 29 > ree 
Each S was seen individually by one of ae 
examiners for two testing sessions app"? 
imately four weeks apart. 


Three tests were administered, -ai ah 
signed to measure problem-solving rigidity e 
a different area of functioning aun al- 
Luchins water-jar technique, an origina pen 
phabet maze, and an original motor ma? 
These tests were constructed so as ring 
structurally similar and capable of — 
the tendency to adhere to an induced goe 
of problem solving when this method h e 
to be the most direct one. In the case “lems 
motor maze, however, the selected pro 


each de- 


100 


Generalization of Problem-Solving Rigidity 


PRACTICE SET 


101 


CONTROL- CRUCIAL 


SOLUTION: SOLUTION: LONG SOLUTION: 
SEVEN FISH LET HIM SING HER RED SUIT 


DIRECT SOLUTION: 
HER HAT 


Fig. 1. Sample problems from the alphabet maze series. 


proved to be too simple; hence no measure 
of rigidity was obtained. Primary considera- 
tion will therefore be given to the relation- 
ship between the water-jar and alphabet-maze 
techniques. 

With respect to administration, the water- 
jar technique was always given first. Follow- 
ing this, one-half of the Ss received the alpha- 
bet-maze technique and the remainder were 
given the motor mazes. The third rigidity 
measure was given in the second testing 
session. This procedure was followed to deter- 
mine whether obtained correlations between 
rigidity measures would differ as a function 
of the temporal interval between tests. Since 
this was found not to be the case, it was con- 
sidered defensible to pool alphabet-maze scores 
from the two administrations. 

Since various adaptations of the water-jar 
technique as well as instructions for its ad- 
ministration are reported elsewhere [3, 4, 8, 
10], the actual test problems used will not be 
reproduced here. Suffice it to mention that the 
series consisted of two practice problems, de- 
signed to familiarize Ss with the various steps 
that could legitimately be utilized in the 
solution of later problems; one control prob- 
lem which could be solved either by a long 
method (B-A-C-C) or a direct one (A-C) 


which is actually one of the steps of the long 
method; five Einstellung or set problems 
soluble only by the long method; four crucial 
problems, similar to the control problem and 
soluble either by the long or direct method; 
one extinction problem soluble only by a new 
and direct method not used in any previous 
problem; and finally two additional crucial 
problems. 

No published account of the alphabet-maze 
technique is available in the psychological 
literature, although Cowen [2] reports early 
pilot work with this technique. For present 
experimental usage the test series was ar- 
ranged so as to parallel exactly 
technique. The same number of practice prob- 
lems, controls, set-builders, crucials, and ex- 
tinctions were used, in the same order as for 
the water-jar technique. 


the water-jar 


In the administration of the alphabet-maze tech- 
nique, S is told that the object of the task is to move 
from the upper right-hand corner of the maze to the 
lower left-hand corner, spelling out words on the 
way. He may move one box at a time in any direc- 
tion (up, down, left, right, or diagonal) as long as 
the move he makes helps to spell out a word. The 
answer which he is to write in the booklet consists 
of the word or words that will take him fan 
start to finish of the maze. In case mo 


i i re thun 
path is available, the Bee coe 


correct solution 1s the one that 
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uses the fewest number of boxes. Figure 1 — 
of a sample practice, set, and “control-crucia 
in this series. 

a Rey oe used consists of moving along 
a down-left diagonal, then straight down, and fi- 
nally directly to the left. The direct solution is a 
straight diagonal path from the upper right-hand 
corner to the lower left-hand corner, The long so- 
lution requires nine moves; the direct one only five 
moves. 


Problems in both test series were presented 
one by one and in order, on individual three- 
by-five index cards, Responses were recorded 
by Ss in examination booklets —a fresh page 
being taken for each problem, 


The rigidity score for each subject on each 
instrument consisted of the total number of 
crucial problems solved by the long method. 
In the case of the extinction problem nonsolu- 
tion in the 21-minute time period allotted 
was considered to be a rigid response. Thus, 


the highest possible rigidity score on each 
instrument was seven. 


Subjects were eliminated for either of two 
reasons: (a) a long solution on the control 
problem, and (b) mathematical or word errors 
on the test problems. 

By these criteria, 47 subjects had acceptable 
records on both tests. The computed Pearson 
r between water-jar and alphabet-maze rigid- 
ity was .42 which was significant beyond the 
-01 level. Since an analysis of test scores indi- 
cated essentially dichotemous, U-shaped dis- 
tributions for both measures, a phi coefficient 
was computed and found to be .46. The sig- 
nificance of this coefficient as tested by 7? was 
beyond the .01 level of probability. A tetra- 
choric r of .59 estimates the degree of rela- 
tionship between the instruments based on the 
assumption of normality of distribution. 


Discussion 
General confirmation of the original hy- 


pothesis is found in the low positive but sig- 
nificant correlation between the two rigidity 


attitudes, in the light of its generalization to 
a different area of functioning. g 
Though the present investigators attach pa 
portance to this finding, caution must 
exercised in its interpretation and generaliza 
tion. A sweeping generalization, such as that 
problem-solving rigidity is a function of per- 
sonality, is not indicated or implied. owe 
conceivably there could be situations in which 
field factors are so compelling as to preclude 
entirely the operation of personality wer 
Illustratively, had the experimenters used L : 
set problems, very likely all Ss would — 
responded “rigidly” on all subsequent a 
cials. On the other hand there appears to ji 
a potential “balance point” in amr 
field conditions, at which a relatively ae 
range of rigidity responses are elicited from 
individuals of comparable age, intelligence, an 3 
education. Under such conditions in the pe 
sent study, a tendency towards a generalize" 
mode of problem solution has been demor 
strated, and the likelihood that this tendency 
is “personality-related” strengthened. idity 
The precise relationship between rigic oe 
and other Personality variables is likely to ad 
considerably under different field as 
It may well be that this fact underlies yen 
of the discrepant findings in this area to ¢ are 
€ advance a general hypothesis, hopara 
that the relationship will be greatest W a 
field conditions are such as to bring see 
an otherwise homogeneous group of subj ores 
a U-shaped type distribution of rigidity s€ 
described above, idera- 
A final issue which merits some consid t is 
tion centers around the question of wha ent 
the most fruitful direction that subsea. 
research in this area can follow. We ant 
that it is not helpful and very probably “Js 
even meaningful to ask a question such A ptt” 
there a relationship between rigidity an haps 
sonality?” Such a phrasing, while coger 
inviting to those who seek simple linea! tin 
tionships, overlooks the multiplicity of set ples 
in which the covariation of these gar” 
may conceivably be studied. The pre pti- 
authors view with considerably greater i 
mism an approach which seeks to sP eld 
Precisely a wide variety of experimental i 
conditions and to examine the relation 
between problem-solving rigidity and ° 


yy ge 


designated personality variables, under these 
measurable conditions. 


Summary 


In order to test the hypothesis of generaliza- 
tion of problem-solving rigidity the authors 
have developed an alphabet-maze scale, de- 
signed to parallel the Luchins water-jar tech- 
nique in structure, but to deal with a differ- 
ent area of cognitive function. 

The two instruments were given to 59 
college undergraduates, and on the basis of 
the scoring criteria used, 47 pairs of usable 
test records were obtained. The significant 
correlation between the two measures was 
taken as a confirmation of the original hy- 
pothesis. Under the particular field conditions 
employed, a generalization of problem-solving 
rigidity has been demonstrated. 

The limitations of the present findings, as 
well as their implications for subsequent re- 
search have been considered. 
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The Use of Rorschach Scores to Predict Whether 
Patients Will Continue Psychotherapy 


Frank Auld, Jr., and Leonard D. Eron’ 


Yale University 


Interpreting psychological tests is a serious 
matter, for interpretations affect the lives of 
patients. Decisions to accept patients or reject 
them, to try psychotherapy or not, to use one 
method of treatment instead of another—all 
these may be made on the basis of psychological 
reports, The psychologist, then, has an ethical 
responsibility to be sure that his statements 
are founded on scientific knowledge. He can- 
not afford to rely on guesswork; he must be 
as right as scientific method can enable him to 
be. In this paper we point out that the clinical 
psychologist who wants to be right must be 


tic devices he uses have 


of one sample, the e 
dictor-composite mu 


Separate, independent sample [ Mosier, 9]. 


Background of This Study 


Many Psychiatric clinics have long waiting 
lists and can accept for treatment only a few 
of the many people that apply. Thus there is 
4 great need for diagnostic methods that can 
predict which of the applicants can profit most 
from therapy. Kotkov and Meadow [6, 7] 
ave proposed a method of doing this by 
means of certain Rorschach scores. These 
authors tried out all of the common Ror- 

+The authors wish to thank Dr, Mark A, May, 
director of the Insti i h 

nstitute’s financial 


Midler read this 
gestions, é 


schach scores; they found only three that o 
criminated between patients who continued F 
at least nine interviews and patients who Tn 
By means of Fisher's discriminant ener’ 
Kotkov and Meadow combined these +t 
into a prediction formula: Y = 00038 . the 
00007 D% + .00241(FC—CF). (R are 
total number of responses to the Rors¢ erat 
De, the percentage of these that are Pate 
usual details; FC — CF, the number of ne 
color responses minus the number of Gait 
form responses.) The weights for this ent 
ula were derived from a sample of 98 _— 
who received group psychotherapy at the ap- 
ton VA Mental Hygiene Clinic. When nid 
plied to this sample, from which the ae 
had been derived, the formula correctly = g 
sified 69% of the subjects as “contin 

or “discontinuing” patients. 


: his 
Kotkoy and Meadow then applied se 
formula to a sample of 52 individual P ‘Note 
therapy Patients in the Boston mae a ae 
that this is not a classical cross-validatt from 
sign, since the patients were not ang erap? 
the same population (namely, groe al gam 
patients) as the patients in the ombi 
ple. This type of study, in which we ule 
termined on a sample from one a 
are applied to a second sample dawn 
differently defined population, may 
“validity generalization” [Mosier, amp 
applied to the individual therapy ieee 
formula discriminated continuers „iginal sat 
ters just as well as it had in the orig ec 


r 

. ing CO . 
ple of group therapy patients, pesani 90)" 
Predictions for 36 of the 52 pati a fo 
Not all of the scores entering in a 


-uer 

haaa ntinu apy 
ula, however, discriminated = sychother®? 
quitters among the individual P 
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patients ;* only the FC—CF score did so to a 
statistically significant degree. The R score 
was almost significant for the group therapy 
patients and statistically significant for the in- 
dividual therapy patients. The D9% score was 
significant at the .30 level for the group ther- 
apy patients, but the direction of the differ- 
ence was reversed in the individual therapy 
sample. It is surprising that there was no loss 
in predictive efficiency when the formula was 
applied to a new sample. Shrinkage in multi- 
ple correlation (the discriminant function is 
analogous to multiple correlation) has been 
the regular finding of psychologists who have 
utilized prediction formulas. 

Since predictions stemming from this form- 
ula are based solely on the addition of three 
scores, it might be felt that the formula does 
not get the best possible predictions out of 
the data. We believe, however, that the form- 
ula probably does as well with the materials 
it embraces (the commonly used Rorschach 
scores) as any subjective method for making 
predicitions from these scores would do. The 
reasoning of Thorndike [12, pp. 200-201] 
and the experience of Kelly and Fiske [4, pp. 
200-202] support this view. 

Although Kotkov and Meadow’s prediction 
formula worked well when applied to the 
Boston samples, we felt that it might not be 
equally effective when applied to new samples 
of patients. We shall consider the reasons for 
this belief later on, in the discussion section. 
Our belief that there would be loss in predic- 
tive efficiency led us to try out their formula 
on a new sample of patients. 


Procedure 


Subjects. The subjects are 33 patients who 
received individual psychotherapy in the Psy- 
chiatric Outpatient Clinic at the New Haven 
Hospital. All patients who received individual 
psychotherapy during the period from July 
1949 through June 1952, who were treated by 
a regular staff member (psychiatric resident) 
of the clinic or by a psychology graduate stu- 
dent under close supervision, and who took the 
Rorschach test at or near the beginning of 
treatment (before the ninth treatment inter- 
view) are included in our sample. Two-thirds 


2 Personal communication from Dr. Meadow. 


of these patients were diagnosed as neurotic; 
the remaining third were diagnosed aS suffer- 
ing from psychosis or character and behavior 
disorder. 

Not all patients seen in the clinic during this 
period were tested, since the psychologists’ 
work load permitted testing a patient only 
when the therapist specifically requested it. 

Assignment to continuing or discontinuing 
group. A patient was assigned to the “continu- 
ing” group if he had kept at least 9 appoint- 
ments for psychotherapeutic interviews or if he 
had quit before the ninth interview with the 
consent of the therapist. Otherwise the patient 
was assigned to the “discontinuing” group. 
There were 21 patients in the continuing group 
and 12 in the discontinuing group. 

In counting the number of interviews, we 
started with the one immediately following the 
test administration. Interviews before the test- 
ing did not count toward the total of nine. 
Practically this did not make any difference 
because no patient who was assigned to the dis- 
continuing group had as many as 9 interviews 
whether or not the pretesting sessions were 
counted. 

Recording of Rorschach scores. Records 
were scored according to the procedures de- 
scribed by Klopfer and Kelley [5]. The 
original scoring was reviewed by the authors 
who reached a consensus on the scoring of all 
the responses. The total n mber of responses, 
the number of large-usual-vetail responses, the 
number of FC responses, and the number of 
CF responses were recorded for each patient. 

Computation of Y score. A Y score for each 


patient was computed according to the Kotkov- 
Meadow formula. 


Results 


The Kotkov-Meadow formula failed to pre- 
dict which of the 33 patients continued in 
therapy and which did not. When patients 
with a Y score of .01132 or higher were as- 
signed to the “continuing” group and those 
with lower scores to the “discontinuing” group 
17 out of 33 patients were correctly classified 
(52%). Obviously, this is no better than we 
could do by tossing a coin or throwing dice 
The biserial correlation between Y score and 


the criterion was + .19, which is not signifi- 
cant. 
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Although the Kotkov-Meadow formula did 
not predict continuance of psychotherapy 
among our group, there was a chance that one 
or two of the scores utilized in the formula 
would do so. Accordingly, we tested the cor- 
relation of R, DG, and FC — CF with the 
criterion. The chi-square test showed only R to 
be significantly associated with continuance in 
therapy (7? = 7.14, with 1 df; p < .01). 
When patients were assigned to the ‘‘contin- 
uing” group if they gave 19 or more responses 
(18 was the median number for all 33 pa- 
tients), 22 of the 33 patients were correctly 
classified (679%). 

In order to test whether there was a con- 
tinuous relationship, over the whole range of 
R scores, between R and perseverance in thera- 
py, we applied Festinger’s d test for rank- 
ordered data [2]. This test does not involve 
any assumption about the form of the distribu- 
tion function. According to this test the as- 
sociation between number of responses and con- 
tinuance in therapy was not statistically sig- 
nificant (p = .11). 

The association between FC— CF score and 
continuance in therapy is in the opposite direc- 
tion from that predicted by Meadow’s formula. 
In our sample of 33 patients, a low FC — CF 
score is associated with continuance in therapy. 
This relationship is not statistically significant 
(7° = 3.79, with 1 df; p < .10). 

The use of IQ score as a predictor. Since 
various studies [10, 13, 14] have shown a cor- 
relation between number of Rorschach re- 
sponses and intelligence, we believed it possible 
that the relationship between number of re- 
sponses and continuance in therapy only 
demonstrated that more intelligent patients are 
more likely to continue. To test this hy- 
pothesis, we computed the correlation between 
number of responses and continuance in thera- 
py, with IQ score partialed out. The tetra- 
choric correlation between R and continuance 
was + .55; but when IQ (as measured by 
verbal scale of the Wechsler-Bellevue) had 
been partialed out, the correlation dropped to 
+ .07. Apparently the relationship between R 
and continuance was entirely accounted for by 
their correlations with verbal IQ. The IQ 
score gave better predictions of continuance 
than the number of Rorschach responses. The 
biserial correlation between IQ and continu- 


Frank Auld, Jr. and Leonard D. Eron 


ance was + .71 (significant at .05 level). 
Since IQ scores were not available for all the 
patients, these correlations were all computed 
from a sample of only 23 patients. 


Discussion 


Why did the Kotkov-Meadow formula fail 
to predict continuance in psychotherapy in our 
sample? Before we can answer this question, 1t 
is necessary to consider the reasons why cross 
validation and validity-generalization studies 
are necessary. its 

The necd for cross validation and validity 
generalization. When a prediction formula 15 
applied to the sample from which it has been 
derived, it is bound to work well. When ap- 
plied to a new sample, it often works less well. 
There are four reasons for this: 

1. A multiple correlation, like a 
tion coefficients, is subject to sampling error 
The sampling error of the multiple correlation 
coefficient is, however, greater than the A 
pling error of a simple correlation coefficien ~ 
Thorndike points out, “Even if the correlation® 
with the criterion are all zero in the popu'® 
tion, some prediction will be possible within 
the sample. ... The more predictor variables, 
the higher the multiple correlation which i 
may expect to derive from them, in the er 
of any genuine relationship” [12) P- 2 30 
Since Kotkov and Meadow tried out ae eir 
Rorschach scores before selecting 3 for t? 
formula, their formula in effect is based a 
predictor variables, 27 of which are given ‘tive 
weights and 3 of which are given pos! 
weights. 

2. Thorndike also reminds us t 
dition to any true relationship that m4 
between the test variables and the crite 


Il correla- 


hat “in ad- 
y exist 
rion 1 


few chosen tests capitalizes on chal 
ations in validities and intercorrelation 
variables in the specific sample. - ‘ed to be 
smaller the number of variables selecte upo” 
weighted, the more premium 1s P liee rticu” 
favorable chance fluctuations in those ae ei 
lar variables retained and weighted. Pcie off 
anticipated, therefore, that the multiple, 

relation obtained by weighting only 
few of the tests of a battery will show 
shrinkage, greater than when tl ” 
weights are based on all the tests 


ar 
ame oy 
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204-205]. Kotkov and Meadow gave greater- 
than-zero weights to only 3 variables. The 
shrinkage, therefore, is expected to be greater 
than it would be if they had retained all 30 
variables. Since, however, they probably gave 
zero weights to the other 27 variables because 
these variables would have had very small 
weights, the effect of selecting only 3 out of 
30 is probably much less important than the 
effect of trying out so many variables (the 
reason for shrinkage discussed in paragraph 1 
above). 

3. Quite apart from the two statistical 
reasons just discussed, a multiple correlation 
coefficient may shrink on cross validation be- 
cause the new sample does not resemble the 
old in every relevant characteristic. In this im- 
perfect world, successive samples can seldom 
be identical in every important way. There- 
fore it cannot be strictly true that successive 
samples are “drawn from the same popula- 
tion.” Mosier [9] has called attention to this 
problem. He deals with the purely statistical 
reasons for shrinkage in multiple correlation 
under the heading of “cross validation,” and 
with the shrinkage caused by changes in char- 
acteristics of the samples under the heading of 
“validity generalization.” He points out that 
studies on new and different samples are neces- 
sary to establish the limits of applicability of 
prediction formulas. 

4. The likelihood that the positive findings 
of Kotkov and Meadow — or of any investi- 
gators — are partly due to chance fluctuations 
is increased by the fact that published studies 
are not a random sample of all studies done. 
Because of a feeling among psychologists that 
positive results are more worth while than 
negative findings, published studies contain an 
unusually high proportion of positive findings. 
No one knows how many studies had to be 
done to turn up the positive results that appear 
in the published studies. 

In the field of clinical psychology, cross- 
validation studies are relatively infrequent. 
Probably a prime reason for this is the great 
value placed by the scientific community on 
original contributions. Repetitions of past work 
are valued less than new work: this discourages 
Cross-validating studies. Furthermore, clinical 
Psychologists are likely to feel that any failure 
on their part to reproduce findings of a pioneer 


worker may be attributed to a lack of clinical 
skill. This climate of opinion deters ‘clinical 
psychologists who get negative results from 
publishing their findings. 

Examples of shrinkage in multiple correla- 
tion. An example may serve to emphasize the 
importance of shrinkage in multiple correla- 
tion. Buhler, Buhler, and Lefever [1] worked 
out a “Basic Rorschach Score” to measure ad- 
justment and discriminate between persons 
who are well adjusted and persons who are 
poorly adjusted. Although it was not derived 
by the conventional multiple-regression pro- 
cedures, the Basic Rorschach Score is essential- 
ly a multiple-regression formula. The Basic 
Rorschach Score worked well on the groups 
from which it had been derived, but showed 
a marked drop in discriminating ability when 
tried out on other groups. In the original 
sample it discriminated normal subjects (mean 
score = 21) from neurotics (mean score = 8). 
But when the Buhlers tried the Basic Ror- 
schach Score on a new sample, it failed to dis- 
criminate nurses (mean score = 12) or other 
normal persons (mean score = 14) from 
hysterics (mean score = 12). The Buhlers 
then maintained that the nurses and other 
normal people of the new sample were after all 
not so normal as the original group of normal 
subjects. We believe, however, that the failure 
of the Basic Rorschach Score to discriminate in 
the new sample illustrates shrinkage in mul- 
tiple correlation. 

Kurtz [8] also reported a dramatic shrink- 
age of multiple correlation upon cross valida- 
tion. A list of 32 Rorschach signs correctly 
classified 79 out of 80 insurance agency man- 
agers as successful or unsuccessful — jn the 
sample from which the sign list had been de- 
veloped. When the signs were applied to a 
new sample of agency managers, the correla- 
tion between sign score and success dropped to 
a 02; 

Why did the Kotkov-Meadow formula fail 
in the New Haven sample? Since Kotkoy and 
Meadow did attempt a cross validation of their 
findings — strictly speaking a validity-generali- 
zation study — and found that their formula 
also worked in the new sample, it seems un- 
likely that the failure of the formula when an- 
plied to our sample can be entirely attributed 


to sampling errer. Although tlis seems un- 
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likely, part of the loss in predictive efficiency 
may nevertheless be laid to this source of 
shrinkage. If the fact that the formula worked 
for them but not for us cannot be wholly ex- 
plained by sampling error, it can probably be 
explained by differences between the patients 
seen in the Boston VA Clinic and in New 
Haven Hospital. The patients in our study, 
however, seem to be as much like those seen 
in the Boston clinic as patients in different 
clinics usually are. Therefore, we have dis- 
covered an important limitation to the gener- 
ality of Meadow’s formula. Our finding that 
the formula does not work in the New Haven 
sample thus illustrates the importance of the 
type of study that Mosier called “validity gen- 
eralization.”’ 

Alternative explanations. It is possible, of 
course, that a VA facility gets patients who 
differ from non-VA patients in motivation for 
psychotherapy. In a private-hospital clinic, the 
fee screens out those with only very slight 
motivation for treatment. The VA patient is 
treated free of charge; thus, in a VA facility, 
some patients with marginal motivation begin 
treatment. This difference in motivation may 
affect any attempt to predict continuance of 
patients in therapy. However, the fact that 
Rogers, Knauss, and Hammond [1 1], working 
in a VA clinic, were not able to predict per- 
severance in therapy from Rorschach scores, 
casts doubt on this interpretation. 

Another possible explanation of our results 
is that the treatment procedure is different or 
the skill of the therapists is different. These 
might have an effect on the applicability of a 
prediction formula. In both clinics, the treat- 
ment is described as psychotherapy, but this 
does not guarantee similarity of method. In 
both clinics, psychotherapy was carried out by 
therapists believed to be competent, but thera- 
pists in one clinic may have been much more 
skilled than those in the other. We cannot de- 
cide from the available information whether 

such differences might account for the differ- 
ences in findings. We can say, however, that if 
such differences in method and skill do affect 
the usefulness of the prediction formula, then 
the generality and usefulness of the formula is 
quite limited. 

Implications of this study. Our validity- 
generalizatior, study shows that the Kotkov- 


Meadow formula is not generally applicable 
as a method for predicting continuance in psy- 
chotherapy. It also calls in question these 
authors’ interpretation of their results. Kotkov 
and Meadow believed that patients who con- 
tinued in therapy did so because they had a 
greater capacity for bearing the anxiety aroused 
by psychotherapy. They thought that the FC — 
CF score was a measure of this capacity for 
bearing anxiety — as Rorschach workers 
would say, a measure of “intellectual contro 
of emotions. Our findings that the patients who 
quit have higher FC — CF scores would seem 
to show either that FC — CF is not a measure 
of intellectual control or that intellectual con- 
trol is not related to continuance in therapy- 
Our study does confirm one of Kotkov ae 
Meadow’s findings. Like them, we find tha 
the total number of responses (R) is associate E 
with continuance in psychotherapy. 1 he as 
sociation is not continuous over all values b 
R; i.e., we do not find that the more tepon a 
a patient gives, the better chance there “i at 
will stay in treatment. Rather, we find thé 
he is more likely to stay in treatment ! on 
gives at least a “sufficient” number 0} his 
sponses, i.e., if he gives more than 18, vi 
the median number in the whole sample. spa 
plausible interpretation of this is that ee 
“sufficient” number of responses indicates A ; 
operative attitude and that the patient W also 
motivated to cooperate in the testing he 
motivated to cooperate in the psychot levue 
Our finding that the Wechsler-Be icto 
verbal score is, in our sample, a better P et 
of persistence in therapy than the num t may 
Rorschach responses suggests that this tes edict 
be more useful than the Rorschach for x e 
ing continuance in therapy. Such a use how” 
Wechsler-Bellevue verbal scale shee eal 
ever, be supported by evidence from gre j 
ation studies before it is accepted as Vê ent au” 
Built-in cross validation. The en i 
thors urge the general adoption of an ; 
method of “built-in cross-validation 
good success in the AAF Psychology 
To use this method [Guilford, 3, P- ol jnt? 
investigator divides his original sam 
two random halves. He develops 4 
regression formula from the dat he 
of the sample and then applies it to t a error 
the other half. This method insures t 


vith 


variance will not inflate the coefficient of mul- 
tiple correlation. It does not, however, take 
care of the shrinkage of multiple R attributable 
to differences in the characteristics of successive 
samples. Only a validity generalization study, 
making use of an entirely new group, can do 
this. 
Summary 


A trial on a new sample of patients of a 
formula developed by Kotkov and Meadow for 
predicting whether patients will continue in 
psychotherapy was made by the present au- 
thors. It was found that the formula, which 
used three common Rorschach scores: R, D%, 
and FC — CF, failed to predict which of a new 
sample of 33 psychiatric clinic patients would 
continue in psychotherapy and which would 
quit. Although one of the scores, total number 
of responses (R), was found to discriminate 
the two kinds of patients, it is felt that this is 
a measure of the patient’s motivation to co- 
operate or perhaps an index to his functioning 
intelligence. Both of these can be assessed by 
more appropriate techniques than the Ror- 
schach test. In fact, we found that all of the 
correlation between R and continuance can be 
accounted for by their correlations with the 
Wechsler-Bellevue Verbal IQ; and the latter 
test may be a much better predictor of persis- 
tence in therapy than any Rorschach score or 
combination of scores. 

The findings of this study thus demonstrate 
the need for cross-validation and validity-gen- 
eralization studies. Until such cross validation 
and validity generalization has been done, no 
confidence can be placed in the general appli- 
cability of any method of diagnosis or any 
formula for predicting behavior. 


Received September 2, 1952. 


Rorschach Scores and Continuing Psychotherapy 


N 


v 


10. 


T 


12. 


13. 


14. 


109 


References 


Buhler, Charlotte, Buhler, K., & Lefever, D.W. 
Rorschach standardization studies. No. 1: De- 
velopment of the Basic Rorschach Score. Los 
Angeles: Authors, 1948. 


Festinger, L. The significance of difference 
between means without reference to the fre- 
quency distribution function. Psychometrika, 
1946, 11, 97-105. 

Guilford, J. P. (Ed.) Printed classification 
tests. A. A.F. Aviation Psychology Program 
Research Report No, 5. W shington, D.C.: U. 
S. Government Printing Office, 1947, 

Kelly, E.L., & Fiske, DW. The prediction of 
performance in clinical psychology. Ann Ar- 
bor: Univer. of Michigan Press, 1951, 

Klopfer, B., & Kelley, D. McG. The Ror- 
Schach technique. Yonkers, N.Y.: World Book 
Company, 1946. 

Kotkoy, B., & Meadow, A. Rorschach criteria 
for continuing group psychotherapy. Int. J, 
Group Psychother., 1952, 2, in press. 

Kotkoy, B., & Meadow, A. Rorschach criteria 
for predicting continuation in individual psy- 
chotherapy. J. consult, Psychol., 1953, 17, 16-20. 
Kurtz, A. K. A research test of the Rorschach 
test. Personnel Psychol., 1948, 1, 41-51. 
Mosier, C. I. Problems and designs of cross- 
validation. Educ, Psychol. Measmt, 1951, 11, 
5-11, 
Neff, W.S., & Lidz, T. Rorschach pattern of 
normal subjects of graded intelligence. J, proj. 
Tech., 1951, 15, 45-57. 

Rogers, L. Sọ Knauss, Joanne, & Hammond, 
K. R. Predicting continuation in therapy by 
means of the Rorschach test, J. consult. Psy- 
chol., 1951, 15, 368-371, 
Thorndike, R. L, Personnel selection. New 
York: Wiley, 1949, 

Wishner, J. Rorschach intellectu 
in neurotics. 
265-279. 
Wittenborn, J. R. Certain Rors 
categories and mental abilities. 
chol., 1949, 33, 330-338, 


al indicators 
Amer. J. Orthopsychiat., 1948, 18, 


chach response 
J. appl. Psy- 


Journal of Consulting Psychology 
Vol. 17, No. 2, 1953 


Rorschach Scoring Categories as Diagnostic 


“Signs’ 


91 


Martin Berkowitz and Jacob Levine 


Veterans Administration Hospital, Newington, Conn. 


The use of certain scoring categories in the 
Rorschach for discriminating between the 
“normal,” neurotic, and the psychotic has con- 
siderable appeal, particularly for the clinician 
who is seeking a dependable screening tech- 
nique. As a clinical procedure, these Rorschach 
“signs” would have much to recommend them, 
if their validity in differential diagnosis were 
well established. But as yet few attempts have 
been made to determine on a proper statistical 
basis just how effectively these “signs” are able 
to discriminate between the major psychiatric 
groups. 

In their original study, Miale and Har- 
rower-Erickson [7] found that 9 such “signs” 
could discriminate between the neurotic and 
the “normal.” These were: (a) 25 or fewer 
responses; (b) not over 1 M; (c) more FM 
than M; (d) color shock; (e) shade shock; 
(f) refusal to respond on any card; (£) over 
50% F responses; (h) A% over 50; (i) not 
over 1 FC. These investigators observed that 
the presence of 5 or more of these “signs” “Sug- 
gests strongly the presence of psychoneurosis,” 
Harrower [3, 4] later confirmed these find- 
ings. 
or not these 
now identified as “neurotic 
signs,” are equally able to differentiate between 
the neurotic and psychotic. The difficulty in 
differentiating these two groups on a clinical 
asis 18 not nearly so great as it is between the 
neurotic and the “normal.” Harrower-Erick- 
Son states “, . , we have found in a preliminary 
study with 30 Psychotic patients that while a 
greater percentage than in the case of normal 


1 Submitted with the 
cal Officer, 


eee 
s ‘e over 5 sigs, 
controls will be shown to have over 


; in a 
the number will not be nearly so high ie 
group of neurotic patients. sien! ie in 
the incidence of the individual signs T st the 
the psychotic records is plotted eases 
normal or the neurotic, the curve will he ion to 
to have its own pattern in contradistinct! í 
that of the neurotic or normal” [3, A find- 
In view of the fact that these neni wit 
ings are the result of a preliminary stu¢ ai 
no data or statistics reported, it appears 
able to repeat the study. S 

The present study is therefore an K -orin 
test the validity of these 9 Rorschac “pet wee? 
categories as differentiating “signs an at 
psychoneurosis and psychosis. pa ai o 
tempt will be made to determine whe r- o 
not other scoring categories, particular 7 nsitive 
and number of Populars, are moe o ns ge™ 
differentiators than the others. Ei are 
erally use the latter two categories as ‘ails v 
indicators of psychosis. On this a p 
might expect that F+% and namban signi 
ulars will discriminate in a statistica te 
cant way between the psychotic an¢ 
psychotic. sents from ewe 

Two groups of psychiatric patien compris 
Veterans Administration hospitals e grouP 
the subjects of the present study. were 1 
consisted of 25 neurotic patients sh hos 
domly selected from the open ware vale was 
pital. The diagnosis of psycho review 
made by staff psychiatrists after nae a inte” 
of the clinical findings and a D py 
views. The second group Seem y sale 
chotic patients who were also ran eter 4 
ed from the closed ward of a secon clinic# 
Administration hospital. All were i 
diagnosed as schizophrenic. h grouPs 

The Rorschach protocols of bot 


pt to 


f 


11A 


baee 


patients were thoroughly reviewed to insure 
consistency of scoring. Color and shade shock 
were evaluated according to the criteria of 
Brosin and Fromm [2]. Klopfer’s classifica- 
tion of popular responses was used. Five or less 
popular responses was taken as a psychotic 
“sign” on the basis of Klopfer’s statement that 
“the use of 5 or more popular concepts seems 
to assure that the subject possesses capacity and 
interest in thinking along the same lines as 
other people in sufficient degree” [6, p. 216]. 
The cutting score for F+9% as a psychotic 
“sign” was: taken as 60 which Beck [1] states 
is the “critical minimum.” 

The differences in the number of neurotic 
and psychotic “signs” which were obtained 
from the present two samples were treated for 
significance by means of a test designed to 
measure the significance of the differences be- 
tween percentages [5]. The significance of the 
difference between the neurotic and the psy- 
chotic groups with respect to mean absolute fre- 
quency scores of these “signs” were determined 
by the use of the ¢ test. 


Table 1 


Comparison of “Neurotic Signs” between Neurotics 
and Psychotics in Terms of Percentages 


Total Signs Percentage 


2 
“Signs” 8 
Ei 


Psychotic 
Neurotic 
Psychotic 
Signifi- 
cance of 
Difference 


1. 25 responses 

or less 20 14 80 56 NS# 
2. 1M 13 12 52 48 N.S. 
3, FM>M 11 13 4&4 52 NS. 
4. Rejection 11 6 44 24 NS. 
5. F%>50 15 11 60 44 NS. 
6. A%>50 9 10 36 40 NS. 
T IFG 17 18 68 72 N.S. 
8 CS 16 16 64 64 N.S. 
9. SS 12 19 48 76 05 

5 or more 


neurotic signs 18 15 72 60 NS. 


* N.S.—not significant. 


The results of the present study are sum- 
marized in four tables. As can be seen in Table 
1, there are no statistically significant differ- 
ences between the neurotic and psychotic 
Sroups with regard to 8 of the 9 “neurotic 
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signs.” With respect to the ninth a “sign,” 
shade shock, the difference is significant at the 
.05 level. 


Table 2 


Comparison of Mean Absolute Frequency Scores of 
“Neurotic Signs” between Neurotics and Psychotics 


Mean SD 
"e 2 -8 
one 22 g € asf 
Signs’ 5 3 £ $ FEK 
Zz A 2 & % 488 
1. Number of 21.08 26.00 16.45 15.22 1.07 N.S.t 


Responses 
2. Number of M 1.72 3.04 1.48 3.27 1.81 N.S. 
- Number of FM 2.24 3.16 2.78 2.65 1.16 N.S. 
4. Number of , 

Rejections 76 68 1.07 146 .22 N.S, 
5. F% 56.28 48.96 21.55 20.71 1.20 N.S. 
6. A% 46.32 46.12 15.24 17.34 .40 N.S. 
7. Number of FC 1.16 .92 1.38 1.09 .67 N.S. 


Average Number 4.96 4.76 1.87 2.27 33 N.S. 
of Signs 


we 


* Degrees of freedom is 48 for all categories. 
7 N.S.—not significant. 


In Table 2 the mean absolute frequency 
scores also show no significant differences be- 
tween the two groups. Color shock and shade 
shock are not included in Table 2 because they 
are not quantified. 


Table 3 


Comparison of “Signs” of F+% of Less Than 60 
and Fewer than 5 Populars between Neurotics 
and Psychotics 


Total Signs Percentages 
v K 2° S 
E 8 38 3 
“Signs” $ 2 z 3 
4a A Žž Gi 
F+%60* 3 14 12.5 58.33 
5P 7 18 28 72 
*N=24. In both groups there was one case with an 
F% of zero. 


Table 3 shows that the neurotic group can 
be differentiated from the psychotic on the 
basis of the F +% less than 60, and fewer than 
5 Populars as “signs.” The significance of the 


difference is less than .001 and .002 respect- 
tively. z 
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Table 4 
Comparison of F+% and Number of Populars 
Between Neurotics and Psychotics 


Mean SD 
© 
2 2 g 
= 3 Se 
$ 2 ¢ 2 29E 
“Signs” a 5 f Š . B ke 
FA a z A asa 
F+% 79.58 60.04 17.28 25.34 2.96" .01 
2.367 .03 


No. of P 4.88 3.84 1.63 141 


* 46 degrees of freedom, 
7 48 degrees of freedom. 


When we compare the average F+% and 
the average number of Populars of the two 
groups, we find the significance of the differ- 
ence between the two groups is less than .01 
and .03, respectively. These results substanti- 
ate those in Table 3. 

The results of the present study do not sup- 
port the use of the so-called “neurotic signs” 
to differentiate the neurotic from the psychotic 
patient. The total number of such “signs” does 
not differentiate these two groups. We find 
that five or more of these “neurotic signs” is 
above average for both neurotic and psychotic 
groups. And if we plot the incidence of in- 
dividual “signs” for both groups, we do not 
find a characteristic pattern for each, as sug- 
gested by Harrower-Erickson [3]. For pur- 
poses of screening or differential diagnosis the 
use of this procedure therefore appears to be 
questionable. 

We further find that of the scoring cate- 
gories tested only three show a statistically sig- 
nificant difference between the neurotic and 
psychotic groups. The psychotics consistently 
showed greater shade shock, lower F+%, and 
fewer Populars than did the neurotics. The 
results show that the established cutting scores 
of 60 for F+% and 5 for Populars are effect- 
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tive. These three categories might prove use 
ful as “signs” for purposes of differential diag- 
nosis. 
Summary 

‘Two groups of 25 psychiatric patients each, 
one neurotic the other psychotic, were m. 
pared in the performance on the Rorséia 
with respect to certain scoring categories hea 
are used as “signs.” Only one of the nine wei 
gories commonly referred to as “n anion 
signs” was found to be statistically different 5 
the two groups. The use of five or porie 
these “neurotic signs” to differentiate eN 
the neurotic and psychotic was not ome’ 
ated. A statistically significant difference 
tween the two groups was found with bag 
other scoring categories, F+% and number 
Populars. 
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Group Psychotherapy With Acutely Disturbed 
Psychotic Patients”. 


Herman Feifel 
and Arnold D. Schwartz? 


Winter Veterans Administration Hospital 


Some of the main currents of present think- 
ing with regard to maladjustment in people 
stress the idea that emotional disturbances 
have part of their genesis in interpersonal re- 
lations, and, consequently, that interaction 
among individuals can serve as a basic thera- 
peutic agent. This concept, together with the 
desire to reach more patients than individual 
psychotherapy permits, has resulted in an in- 
creasing use of the group psychotherapy meth- 
od of approach. The method has been ap- 
plied with normals, neurotics, and different 
types of psychotic patients with varying de- 
grees of success. However, a review of the 
literature points up the fragmentary knowl- 
edge and paucity of information existing in 
the field of group psychotherapy with acutely 
disturbed psychotic patients. 

This paper is a report of an exploratory 
study of the effects of an open-end type of 
group therapy on a ward of disturbed psychotic 
patients in a Veterans Administration Hos- 
pital. Since our orientation considers psy- 
chosis to be a form of defense reaction to situa- 
tions of conflict, our efforts were directed 
toward accelerating the development of self- 
esteem and strengthening the ability of the pa- 
tients to cope with factors of social reality. 
Available data on a patient population similar 
to the one with which we worked enabled us 
to make broad statistical comparisons as to the 
relative effectiveness of the group psychothera- 


Py procedure. 


7A portion of this paper was read at the Amer. 
Psychol, Ass., Washington, D.C., September, 1952. 

?From Winter Veterans Administration Hospital, 

opeka, Kansas. 

Formerly a Fellow of the Menninger School of 
Psychiatry, Topeka, Kansas. Now at Langley-Por- 
ter Clinic, San Francisco, Calif. 


Method 


Subjects. One of the authors was assigned 
as resident psychiatrist to a locked ward on the 
Acute Section of Winter Veterans Administra- 
tion Hospital for a period of six months, Dur- 
ing the first three months, he used a program 
of milieu therapy, i.e., occupational therapy, 
corrective activities, special service functions 
including gym, attendance at 
dances, etc. Some of the patients, in this 
interim, also received hydrotherapy, electro- 
convulsive therapy, and individual psycho- 
therapy. During the second three months, the 
ward Program was identical for the patients 
with one exception — the addition of group 
psychotherapy sessions. > 

There were 21 beds on the ward and these 
were occupied by 100 Patients during the six- 
month period being considered, 51 during the 
first three months, and 49 during the second 
three months. Since there was an overlapping 
of certain patients from the first to second 


Table 1 
Distribution of Diagnostic Categories in 
Experimental and Control Groups 


movies and 


Category Experi- Con- 
mental trol 
Schizophrenic, paranoid 14 14 
Schizophrenic reaction, 

unclassified 8 10 
Manic-depressive 3 1 
Involutional melancholia 1 1 
Alcoholic psychosis 2 2 
Organic psychosis 2 1 
Depression, unclassified 2 1 
Psychotic depression = 1 
Character-disorder 2 3 
34 34 
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Table 2 


Means`and Standard Deviations for Intelligence, 
Age, and Education of Experimental 
and Control Groups 


Experimental Control 
Measure group group 
(N=34) (N34) 
IQ 
Mean 104.3 102.4 
SD 5.2 4.2 
Age 
Mean 35.4 34.2 
SD 11.8 12.6 
Education 
Mean 10.4 10.1 
SD 2.6 3.0 
Table 3 


Marital, Urban-Rural, and Race Status of 
Experimental and Control Groups 


Experimental Control j 
Status N % N % 
Single 12 35 14 41 
Married 12 35 2 35 
Divorced 10 30 8 24 
34 100 34 100 
Urban 16 47 19 56 
Rural 18 53 15 44 
34 100 34 100 
White 33 97 32 94 
Nonwhite 1 3 2 6 
34 100 34 100 


three-month period, and because we considered 
only those patients as part of the experimental 
group who had attended a minimum of eight 
group psychotherapy sessions, our experimental 
group comprised 34 patients which was, fortui- 
tously, the number of control patients available 
to us from the first group. 

Tables 1, 2, and 3 present the relevant in- 
formation concerning the background of both 
groups. Table 1 indicates that both groups, 
composed mainly of World War II male 
veterans, in various stages of remission* were 
_ “It should be kept in mind that although the ma- 
jority of our patients were acute psychotics in the 


sense that this was their first or second “break,” a 


T were now in the exacerbatory stage of a long 
1 iness, eg, one of our manic-depressive patients 
had bee 


n ill svoradically for twenty years, 
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well matched in terms of their diagnostic 
classification. The paranoid schizophrenic an 
schizophrenic reaction, unclassified, types ° 
category dominate both the experimental an 
control groups. 

The “findings in Table 2 show that a 
groups are also well matched on the varia) : 
of intelligence, age, and education. Both i 
slightly above average in intelligence, have @ 

ere; (the age 
extende 
it of the 


; <a 
approximate mean age of 35 years 
range of the experimental group 
from 21 through 61 years of age; thi 


“3 0 
rears 
control group from 22 through 6+ ie the 
age), and possess an educational leve 


A x -o complete 
equivalent of approximately two comi 
years of high school. zeneral 

The data in Table 3 illustrate the a o 
a et k rega 
similarity of both wah Fa an 

2 s š ack una, © 
marital situation, urban-rural backgre > has # 

s ; . 3 rou 
racial status. The experimental grouf ore 
few ™ 


groups 


few less single individuals and vl with 4 
i > e 
divorced persons, and more peop ol grouP: 

is ri Ë 
rural background than does the cont 


axper!” 

in the expe 
l group 
born: 


Except for one Negro patient 
mental group and two in the contro” ï 
all the patients were white and American 

Analysis of the occupational bine il d 
the groups revealed that, in sa og 
farmers, professionals, and sem g0 pe! 

In both groups, approximately * a the 
of the patients were admitted from n ie 
hospital, the remainder coming to 
from other parts of the hospital. 

The duration of present hospita’ 
the majority of patients in the eP an A 
and control groups was usually p in bori 
months, although a small minor pe 
groups had been in longer, < 
little as two or three weeks. 
mentioned, a minority in each E jual PS 
ECT, hydrotherapy, and indivi®", etH 

ie one eral MI tiv! 

therapy, in addition to the gene erapy *° 
apy program and group psychot® 


- for 
«rion 
lizati ental 


ym 
pr tw? 


ut 
i i : 10 
ties of the experimental group- wie ae en 
~ i e : 

Procedure. ‘The meetings z gaii a es 
and took place twice weekly a ail 2 oul" 
setting in the ward’s dayroom. ient w 
sions were held with the exper 


; par pef 
a circula” i ote 
to k of t 
t in 4 


Chairs were arranged in . 
the two therapists sitting na 
and the patients being free to 
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chairs, on card tables, or on the floor, if they 
so desired. Attendance at the meetings was 
explicitly made voluntary. The group itself 
was of an open-end type, i.e. while old 
members of the group were leaving for other 
wards, trial visits home, or discharge from the 
hospital, new additions to the ward were al- 
lowed to participate in the meetings as soon as 
they felt so inclined. Because of the turnover 
of patients, our last session had only three of 
the original participating patients. 

The group structure was of a permissive 
nature, i.e., the patients were free to talk about 
anything they desired, sit wherever they 
wished, walk out of the meeting if they felt 
like it, etc. However, since these were acutely 
disturbed individuals, one restrictive aspect 
was introduced. The patients were told that 
no physical assaultiveness or self-destructive 
behavior would be permitted during the group 
sessions, 

In the matter of recording the sessions we 
considered various alternatives: wire or tape 
recording, a secretary using shorthand, or 
taking notes ourselves. We decided on the 
last course since it permitted us to secure 
verbatim notes, as well as get a record of 
feeling-tones and gestures which might have 
been overlooked if only verbal productions had 
been recorded. It also allowed us to note, more 
specifically, the therapists’ reactions to the pa- 
tients as well as their behavior toward the 
therapists. 

Therapists. The two therapists consisted of 
the ward doctor and section psychologist who 
alternated in the roles of group leader and re- 
corder-observer. The orientation of both was 
to create a friendly and noncritical atmos- 
phere — to foster the patients’ introducing as 
much of the material as possible and their lead- 
ing the discussions. The therapists did become 
active under certain conditions, e.g., to help a 
patient enter into the discussion and to aid 
him express himself, to promote group inter- 
action, etc. The approach can best be cate- 
gorized as the “analytic-investigative” orienta- 
tion described by Standish and Semrad [5]. 

Rating of improvement. Judgment on the 
improvement or nonimprovement of patients 
was made by the ward doctor, Chief of the 
Acute Section, and Assistant Chief of the 
Acute Section, At the time of rating the pa- 
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tients, none of the raters were aware that their 
judgments would be used as a criterion in 
evaluating the effectiveness of group psycho- 
therapy activities. Although their judgments 
were made independently, they were probably 
influenced by previous mutual discussions con- 
cerning the hospital reeds of the patients. 
Nevertheless, the very strong agreement with 
respect to the patients’ status in practically all 
of the cases, we feel, tends to make the role 
of contaminatory bias less important than it 
might otherwise seem. 
Results 


Group Process. The most striking aspect of 
the experimental group’s development was its 
maturation from a gathering of individuals, 
most of whose members talked unintelligibly, 
to a cohesively interacting group animatedly 
discussing common problems and drawing upon 
one another for help. 

The first meetings were characterized by a 
good deal of open hallucinating, unintelligible 
talk, and expressions of autistic thinking, e.g., 
one of the more disturbed patients stated his 
concern over what doctors do to patients as 
he incoherently discussed experiments dealing 
with the mixing of animal and human blood. 
Another patient, who had been homicidally 
assaultive, mentioned, with a smile, that he 
had many friends whose heads were going to 
adorn fence posts and that his mother would 
not escape his wrath either. Testing the new 
situation was obvious, e.g., one of the patients 
stated his feeling that the aides were “no 
damn good, a bunch of incompetents who only 
worked here because they couldn’t do any- 
thing else” ; another asked, “If we speak to you, 
won't we stay here longer ?” Participation of 
most of the members during these early ses- 
sions was minimal and talk was directed to the 
therapist rather than to other group members, 
Also, a good deal of physical activity was 
noticeable ; some of the patients walked around 
the room, others made frequent trips to the 
water fountain, and some walked out of the 
dayroom altogether. 

As the sessions Progressed, a few of the 
patients began griping over personal incidents 
to the therapist, still in a kind of Private con- 
versation setup, “When am I going to get my 
laundry back?” “Why can’t I go to the typing 
class with the open ward?” etc. Little by little, 


a ere eres cece... 
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they became interested in how other group 
members were reacting to what they said, CB. 
one of the patients, telling the therapist that 
he felt responsible for his father’s death, turned 
to the group asking for their judgment about 
what had happened. Gradually, more and 
more group members. started voicing their 
feelings. Soon the participants were discussing 
common personal problems, e.g., “Will my 
mind be affected because of this sickness I’ve 
had?” “Should I tell my employer that I've 
been in a mental hospital?” as well as common 
ward problems, e.g., “What should we do 
with those people who spit into the water 
fountain?” “How about not having any piano 
playing when some of us are trying to sleep?” 
etc. Exchange of ideas and feelings became 
frequent and often heated. No longer was 
the group composed of “passive spectators,” 
but it had become one in which a definite 
“we” feeling predominated and group members 
had developed feelings of responsibility toward 
each other, e.g., one of the patients who had a 
large farm offered another member of the 
group a job on it if he couldn’t find something 
in his own line after he got out of the hospital. 

A definite by-product of the meetings was 
the sizeable number of patients who ap- 
proached both therapists after the sessions re- 
guesting individual interviews concerning ma- 


terial they had previously repressed or couldn’t 
talk about. 


The general developmental 
group appears to b 
Frank’s [2] fin 


process of our 
e similar in many respects to 
; j dings with chronic schizo- 
phrenic patients and to those of Luchins [4] 


with open ward patients in the NP section of 
a military hospital. 


As to the theme 
— the early 
pressions of 


s getting 
tal illness, and the 
ide°the hospital. 


Herman Feifel and Arnold D. Schavartz 


Some of the major facets that the oti 
psychotherapy experience seemed to a : 
and accelerate for most of the group member 
were: 4 

Catharsis — allowing the expression a 
anger, resentment, and various negative “i 
ings against the hospital and aides, and oea 
against the ward doctor and therapists. ients 
example, one of the more disturbed jawne 
assaulted one of the therapists during an ne 
session. The question of what prompte ish- 
patient to do this and the problem of eg 
ment were brought up immediately anc H 
cussed. The group was informed that Mer 
tient would be sent to a more secure or 
ward so as to protect others from the aan 
and the patient from his own fears. The g ugh 
took three to four meetings to work thro vas 
their own anxieties before the ee a 
dropped. The therapists noted that my, with 
the patients identified themselves both 


s they 
x Es aqd, as 
the therapist who had been assaulted, Jd have 
Raa y wou 
individually expressed how they wo truck 


handled the situation if the patient had ° 
one of them, and with the assaultive "pappen 
as they speculated about what should : who 
to, and what was happening to the patie” ulses 
could no longer control his aggressive gh the 
It was also surprising to note how much ” an 
zroup interaction was based on “rubbing 
Ke Lee ” - . ; 
ei 
| on — increasing tting 
ability to communicate with others and g° ilate 
them to the point where they could fort ii 
and define their problems. An instance oe 
is where one of the patients talking ie 
ently was soon interrupted by another 
said, “How can the doctor understan 
when I can’t?” -4 and ov 
Leadership — despite the moving 1n 6 he 
of members and the general flexibility ati 
group, there was always a core of sim “took 
Participants who “carried the ball.” T ey the 
the initiative, many times, in responding - ot 
queries directed to the therapists an g 10% 
ganizing the discussions. It was ee and 
that the assumption of group leaders” of the 
Participation was independent of the age om” 
patient and based more on individual P 
ality factors. 
Insight — many of the group 
came to realize that the conflicts they 


tient, 


pet 


mem er? 


had W 


———— 
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of their own making and not just due to “bad 
luck,” “members of their family,” or “society’s 
fault.” They saw that they would have to ad- 
just themselves to other people and not the 
whole world to them, and that neither medi- 
cine, the hospital, nor the therapists could help 
them unless they tried to help themselves. 
This is aptly illustrated by a conclusion the 
group came to at the end of a discussion con- 
cerning ways of handling the international 
situation, “How can we talk about changing 
others when we can’t even change ourselves?” 

Control — strengthening of ego factors was 
definitely apparent in the increased ability of 
the group members to direct and respond to 
strong verbal criticism without being over- 
whelmed, in their growing ability to identify 
with other members, and in improved reality 
orientation. 

It should be remembered that the group 
process described above was by no means a 
linear development but rather indicates the 
general direction of the group. Also, the find- 
ings were characteristic of the group as a 
whole and do not imply that each group 
member maintained this general progress. As 
a matter of fact, some members of the group 
became even more disturbed during the period 
of group psychotherapy. 

Quantitative comparison between experi- 
mental and control groups. In terms of broad 
statistical comparison, Table 4 shows the hos- 
pital status, after three months on the ward, 
of the experimental and control groups. It is 


Table 4 


Hospital Status after Three Months on the Ward 
of Experimental and Control Groups 


Status Experimental Control 
tatus N % N % 
More 
Disturbed* 4 11 7 21 
No 
Improvement 6 18 10 29 
Improved} 24 71 17 50 
34 100 34 100 


*More Disturbed = transferred to a closed ward with 
Sreater security precautions. 


tImproved = discharged from the hospital, left the 
hospital on trial visit, or transferred to an open ward. 


evident that more of the patients who had the 
benefit of group psychotherapy improved and 
less became more disturbed than the group 
which had not received psychotherapy. In the 
experimental group, 2+ patients showed im- 
provement as against 17 patients in the control 
group, and only + patients in the experimental 
group became more disturbed as against 7 pa- 
tients in the control group. No improvement 
was indicated in 6 patients in the experimental 
group and in 10 patients in the control group. 
A chi square was calculated combining the 
more disturbed and no improvement patients 
into one “no improvement” category. Yates’s 
correction for continuity was applied (1 df). 
Table 5 indicates the y? to be 2.22 with a p 
value of 15 per cent. While this is not very 
significant, the trend is in favor of the experi- 


Table 5 
Chi-Square Analysis of Table 4 Combining More 
Disturbed and No Improvement Categories 


Experi- 
Status mental Control 

b fe fo fe dx » 
No 
Improve- 
ment 10 (13.5) 17 (13:5) 

1 222 35 

Improve- 


ment 24 (20.5) 17 (20.5) 


mental group. In addition, analysis of the 
ward records of both groups indicated that less 
medicinal and physical sedation, i.e., barbitu- 
rates, hydrotherapy, packs, etc., was necessary 
for the group psychotherapy patients. A sam- 
pling follow-up of members from both groups, 
six months after the present study, revealed 
that a similar status to the one indicated in 
Table 4 existed in the improved-disturbed ra- 
tio in the experimental and control groups. 
Unfortunately, we did not have as a control 
a group that had received no therapy at all so 
that the effects of natural remission could be 
evaluated relative to the effectiveness of our 
milieu and milieu plus group psychotherapy 
groups. 

Qualitative differences between experimental 
and control groups. Above and beyond the 
quantitative findings, the authors were strong- 
ly impressed by the qualitative differences be- 
tween the groups. 
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Relationships between patients in se = 
perimental group were more menny = easy. 
The content of “gripe sessions, ne oe 
weekly, changed from individual complaints 
to questions affecting the group. Instead of 
the usual unproductive griping, these Sessions 
were utilized by the patients to make their 
ward situation more tolerable and pleasant. 
Where, at first, the ward doctor led these 
meetings, one month after the group psycho- 
therapy meetings had been started, the group 

elected their own spokesman to conduct the 

meetings. They appointed a secretary who 
took notes and informed the group of sug- 
gestions brought up during the week, action 
taken on previous Suggestions, new members 
admitted to the ward, etc. They chose an 
athletic chairman who took the lead in inter- 
ward volleyball and intraward bowling, etc. 

n effect, the ward doctor became relegated 
to a position of advisor to the group. The 

i rdinarily reactive to 

» &g, one of them 
found it very difficult to justify his claim that 


for a “sprained 


ard to maintain a 
supercilious air when several patients brought 


up the point that it seemed strange to them 
that with all his education, he was on a locked 
ward just as the rest of them, Further, it was 
seen that although a Patient could feel free to 
“act crazy” for the doctors, nurse, or aide, he 
before his fellow 


Psychotic behavior 
and garbled language decreased, 


“phony front” bef 
result of the grou 


tales and Protests disappeared af 


rom a previous attitude of unconcern 
teward the ward, the patients in the experi- 
mental ‘Zroup developed a definite interest in 
their ward s'irroundings, Problems of ward 


temperature, ventilation, cleanliness, Etes se 
came matters of import. During a meeting 8 
the group, one of the patients traver an be 
point that the windows and CHOBE be six 
filthy and hadn’t been cleaned in the past ea 
months, and that it probably would take = 
other six months to get them cleaned A 
the usual channels of red tape, The "e 
was temporarily dropped. However, a ii 
days later, the patients took the mekte 
asking the nurse and aides if they could 7 i a 
the windows and curtains. The result add 
joint effort in which both ward personne! ¢ 
patients participated. , sche tke 
The ward doctor found his own “ec sia 
Proving and his interest in the individua i 
tient increasing when the patients ici 
show some change after group therapy lelu- 
been in progress for a short while. pe dë- 
sions, hallucinations, and psychotic ta his 
creased, the doctor felt more at ease on dis- 
ward rounds and in interviews, both enii 
cussing the patient’s conflicts and in sien a 
ing to formulate for himself the ona The 
pects of the problems they AIRCO aae 
patients themselves also evidenced ie A R 
dom in bringing up meaningful mate r 
the general permissive atmosphere BENS pptiatl 
the group psychotherapy sessions, both + mee 
and doctor were better able to discuss t cone 
ety attending the patient’s atte g 
cerning his leaving or remaining in osthos- 
pital, as well as his concrete plans for P 
pital adjustment. n the re 
The meetings also had an effect = the pa 
lationship between ward personnel ae about 
tients. In one of the “gripe sessions, 
two months after the inception of Be 
Py, the patients asked why 
allowed out-of-doors in the ee that 
weather was good. An aide repue when 
could not watch all of the panen o t sevet? 
was the only one on ward duty and tha nt su% 
A ; atien. ity 
patients might try to elope. A esponsi wo 
gested that the group itself take res ted clo? 
for informing the aide of any ie 1 = 
ment. A few patients stated that discus 
want such responsibility. Further + yo j Ee 
ensued and as a result of a major aire oat 
entire group decided to take fed up pe 
Future events showed that they Tr aide ° 
end of the bargain, informing 


era- 
p th 't 


he 
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Several occasions when one or two of the more 
disturbed patients attempted to get “lost” from 
the group when going to or returning from 
a group activity. The patients were able to 
form realistic relationships with ward person- 
nel on the basis of the kind of individuals they 
Were rather than on the basis of what they 
thought the ward personnel represented. For 
example, they complained about one specific 
aide being lazy because he did not help them 
with their food trays as he was supposed to do, 
an opinion which was shared by most of the 
staff. 

The sessions also had their effect on relations 
between the ward doctor and ward personnel. 
Before the group therapy sessions with the pa- 
tients were begun, ward personnel brought up 
few problems of their own at their weekly 
mectings with the doctor. After the group psy- 
chotherapy meetings were begun, a noticeable 
change took place in their interest. Nurses 
and aides began to ask more questions about 
the patients and to bring up various problems 
they had in dealing with them. Sharpening of 
interest was indicated by a developing concern 
over the proper attitudes they should adopt 
toward various patients, particularly with re- 
gard to handling their anxieties by means other 
than the usual ones of sedation. 

In summary then, perhaps more important 
than the quantitative improvement in the 
group psychotherapy patients, in this instance, 
was the devel and quality of their improvement 
and its concomitant healthy effects on the func- 
tioning of the ward doctor and ward personnel. 


Discussion 

A characteristic aspect of the group psycho- 
therapy sessions was the manner in which it 
elicited material which had not come out pre- 
viously. We think this was due to the group 
structure setting which stimulated expression 
of problems and conflicts to a group of peers 
also having similar emotional difficulties. Be- 
Cause of this aspect, group psychotherapy can 
often serve as a springboard and valuable ad- 
junct for individual psychotherapy in its grap- 
pling with the more deep-seated emotional 

Problems of the patients. 
» Another characteristic finding was the 
Proving ground,” so to speak, that the sessions 
offered to most of the patients before they left 
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the ward or hospital, for testing and _convine- 
ing themselves that they would be able to 
handle themselves in a less “protected” en- 
vironment. 

We were definitely impressed at the move- 
ment of the group as a whole, despite its open- 
end structure with the constant moving out of 
old members and the incoming of new ones. 
It is quite conceivable that positive results 
might have been intensified had the group been 
a closed one; the point remains, nevertheless, 
that forward changes did occur despite 
changes in the membership of the group. 

Another revealing result relating to the 
homogeneity of groups was our experience that 
the age differences, per se, of our patients were 
of little consequence. If anything, the age dif- 
ferences, at times, tended to bring perspective 
to many of the issues discussed, We do not 
imply that the age factor cannot be a signifi- 
cant one, but rather that in a group of veter- 
ans who have similar emotional problems and 
past experiences, and interests in common, it 
does not appear to be as important as in other 
patients. 

The sessions emphasized that far from being 
seclusive and withdrawn, necessarily, our dis- 
turbed patients showed marked sensitivity and 
reactiveness to other group members. Marked 
changes in personality were not too obvious in 
most of the group, but what was patent was 
the gradual disappearance of asocial tendencies, 
increased reality awareness, and a reorienta- 
tion of attitudes, e.g., “We've got to change, 
not the outside world.” Part of the patient’s 
pathology, as Breckir [1] has correctly 
stressed, disappears when he becomes an in- 
teracting group member, 

As to technique — we both had to guard 
against getting too involved with content ma- 
terial. Much better results w 
we focused on the feelings being expressed by 
the patients, In attempting to catalyze the 
discussions, we tried, as much as possible, to 
make use of the patients’ Productions and 
level of discussion as long as we felt comfort- 
able in doing so. We did not confront the pa- 
tients with past behavior or case-record ma- 
terial except where they themselyes brought 
them up in discussion or by symptomatic by- 
havior during the meetings, 

We thought that our sitting next to one 
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another enabled the patients to equate us and 
helped them see that each of us assumed the 
same role at alternate meetings. By leaving 
the seating arrangements up to the individual 
patient, a shy patient could progress at his own 
speed from the periphery of the group (or from 
the floor behind a chair) to the center of the 
group next to the leader, Further, a patient 
who was angry could express his feeling by 
walking out of the meeting, or by moving to 
the periphery — a move which lent itself to 
discussion. 

We felt that having two therapists for the 
group was a decided advantage. At the be- 
ginning, particularly, it provided supports that 
enabled us to weather unpredictable outburts 
of aggression. The second therapist functioned 
as an “observer” as well as “recorder” in the 
sessions he did not conduct. We found this 
viewpoint to be very helpful during discus- 
sions between ourselves dealing with the ses- 
sions In pointing out transference and counter- 
transference phenomena, a 
blind alleys. One thing 
noticeable in the early s 
ceptualization of the the 


as parent surrogates with consequent attempts 


ng the 
wedge that one was the ward doctor and the 


When the patient 
would not work, it 
vered, as Hayward, 


allowed more targets to 

Pressing ambivalent feelin 
greater therapeutic force t 
One of the ma 


aspect of group psycho- 
om the procedure itself. 
does not permit any defi- 
uite conceivable that had 
oup received the benefit, 


ur study obviously 
nite answers, 


Psychotherapy ty . 
‘ Ype appears 
apeutically he'pful ill 


Herman Feifel and Arnold D. Schwartz 


We found it difficult to evaluate the effect 
of concurrent therapies that specific patients 
Were receiving; also to assess properly the re- 
lation between time spent in the sessions and 
the therapeutic results obtained since the pa- 
tients in our group ranged in participation 
from 8 through 20 sessions. 

It is quite apparent that our study poses 
more questions than it answers. Research in- 
volving more controlled studies of process, ob- 
jective evaluation of therapeutic effectiveness, 
as well as extended time-series measurements 
is a necessity before we can be certain of the 
validity of any of the observations glreney 
made. Some of the main areas that deman 
future attention are the comparative efficacy 
of the open-end and closed type of groups, OP- 
tional versus set topics, the relative effective- 
ness of group psychotherapy with different 
types of patient populations, dynamics of the 
group psychotherapy process and its relation 
to what occurs in individual psychotherapy, 
multi-therapists in group psychotherapy, ain 
as has been mentioned previously, the bes 
tion” aspect of group psychotherapy, and ye 
problem of natural remission. One mode É 
approach, not employed by us, that could : 
helpful in shedding light on some of thes 
questions would be the use before and after 
treatment of various measures of personality 


. i ue. 
assessment, like the Rorschach, Q technique 
etc. 


Summary r f 
l Twenty group psychotherapy sessions i 
an open-ended structure were held with -_ 
ly disturbed closed-ward patients in an inly 
veterans hospital. They were diagnosed mai! ic 
as paranoid schizophrenics and schizophren™ 
reaction, unclassified. Two therapists, roa e 
whom was the ward doctor, alternated in er. 
roles of group leader and recorder-obser Y" 
espite the continued entrance of from 
patients, the group, as a whole, moved ions 
autistic thinking and individual preoccupa" se 
fo concern with common problems and m 
realistic social relationships. iscus- 
3. The main themes dominating the dis rel- 
sions were: (a) guilt feelings toward ee 
atives, (5) sex adjustment problems, (o) ] re- 
trol over aggressive feelings, (d) person? 
sponsibility for illness, (e) the stigmê 


«ao the 
mental illness, and (f) adjustment outside 


hospital. 

+. In group interaction, the age factor, per 
Se, was less important seemingly than the 
Similarity of problems and commonness of 
background in the patients. 

5. The sessions were helpful in eliciting 
material not easily secured otherwise. 

6. The patients appeared to give up part of 
their pathology in becoming interacting mem- 
bers of the group. 

7. The presence of more than one therapist 
Probably facilitated the therapeutic process. 

8. The method of group psychotherapy is 
adaptable to treating acutely disturbed schizo- 
Phrenics, 

9. A broad statistical comparison of the 
nh psychotherapy patients was made with 
erota Stroup of patients, similar in back- 
tean a previously on the same ward with 
an Physician and an identical treatment 

am except for the group psychotherapy. 
ied td psychotherapy patients showed 
sive fis € alesis However, a more impres- 
inent ing was the quality of the improve- 
and its reflection in general ward activ- 
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ities and relations with ward personnel. 

10. Areas for further research were indi- 
cated as well as the necessity for more accu- 
rate and controlled studies to substantiate the 
validity of the present observations. 


Received August 27, 1952. 
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The Treatment of Delayed Speech by Client- 
Centered Therapy 


Henry J. Dupont 
George Peabody College 


Theodore Landsman 


Vanderbilt University 


and Milton Valentine 
Stanford University 


One of the speech problems dealt with by 
speech therapists is called “baby talk,” “re- 
tarded speech,” or “delayed speech.” Berry 
and Eisenson [2] and Van Riper [7], believe 
that when an emotional disturbance coincides 
with the development of speech, there will be 
speech retardation. This is apparently duc to 
the fact that speech is an overlaid function, 
with all of the anatomical parts used in speech 
having a more basic biological function. These 
parts, the tongue, palate, lungs, etc. are free 
for speech only when the organism is operating 


with a certain minimum of dynamic integra- 
tion. 


If the very young child is neglected or re- 
jected and reacts with highly motivated dis- 
organized behavior, it is easy to see how the 
development of speech could be influenced ad- 
versely. The correction of the emotional diffi- 
culty might therefore be considered an essential 
first step in delayed speech therapy. 


Delayed speech offers a unique challenge to 
the psychotherapist who emphasizes the growth 
aspect of therapy as the client-centered thera- 
pist does. If the client-centered therapy, as ad- 
vocated by Rogers [4, 5, 6], does result in re- 
leasing the potential for growth and improved 
interpersonal relations, then client-centered 
therapy should prepare the child for speech 
growth also. 


tA Preliminary version of this paper was pre- 

Society i 4 nen convention of the Southern 
y o ilosophy and P: i 

Ponta a phy sychology, Section on 


inical Psych i = 
nessee, April n, 1952. Sychology, Revawalls; “Dex 


Recently Backus and Beasley, commenting 
on eight years of experimenting with ag 
of therapy, have stated that “the chanh ait 
speech behavior which took place depended ue 
upon devices for breathing, blowing, peace 
exercises, ‘ear training’ and the like, and “oe 
upon forces operating in the interpersona 
lationship between child and therapist. » + 5 
p. 4]. It is even possible, as Werner cial 
ports, that as the child’s emotional and n 
adjustment improves in therapy, his speech ua 
improve without any treatment of the sp tion 
problem as such. This is a plausible predicto. 
because therapy usually results in an imp” an 
ment in social and interpersonal relagion> cia 
speech is a social skill very essential to ieu 
and interpersonal relations. The social uate 
of almost every child will contain 4 ae n 
pressure and stimulation for correct ia 
which the child will be able to respond 


his adjustment improves. 


t 
; Seite resen 
It is our purpose in this paper tO p 


+. an 
and discuss the case history, diagnos! The 
treatment of one case of delayed spec’ apy 
appropriateness of client-centered et 
treatment will be discussed and evaluat 


Case History and Diagnos!s 


rite 
Johnny? was referred to one of a 
(a speech therapist) by a welfare ne r 
speech correction. His social worker gieo!” 
that Johnny was having considerable geti” 
ae i 
2In order to protect the child’s identit” 
cious name is used. 
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Research on Nondirective Play Therapy 


both in school and in his foster home. In fact, 
he was a problem to his social agency, for his 
speech made it impossible to find a satisfactory 
permanent foster home for him. 


When first seen by the therapist Johnny ap- 
Peared small for an eight-year-old, he was thin, 
had delicate features, and a very forward and 
out-going manner. His attempts to speak re- 
sulted mostly in vowel sounds, frequently 
garbled. His hearing as measured by the 
Maico Clinical Audiometer was normal and he 
missed only three words out of thirty on the 
children’s version of the Anderson Speech 
Sound Discrimination Test. A phonetic an- 
alysis was made of Johnny's speech for use in 
studying progress in his speech correction and 

or diagnosis. Because of his speech, an ade- 
quate measure of his IQ was not obtained, but 
ed school performance and his general behav- 
tor did not suggest mental deficiency. 

_A report submitted by the social worker pro- 
vided the following information: Johnny was 
the sixth of seven children. When he was three 
and while his mother was carrying her seventh 
ee his father was arrested for larceny and 

is to jail for eight years. Shortly after this 
ah ne became completely disorganized and 
til Sa to care for the children. It was not = 
his ot year later, however, that Johnny anc 
moth ae brother, Tom, were taken from his 

er and placed in a temporary foster home. 
ity I and four months later Johnny and 
Posedly her were placed in another home sup- 

Petes for permanent placement. The new 
becaus Mf eae wets unable to accept Johnny 

tothan he didn’t “talk right,” and he and his 

on er were returned to the temporary home. 
aa va soon placed in another home, but 
w Set remained in the temporary home 

From kn was living at the time of his referral. 
intery; a above, and from his behavior in the 
rom at it was felt that Johnny suffered 
With so Ings of rejection to which he reacted 
nosis E a and aggressive behavior. A diag- 

ecided delayed speech” was made and it was 
or in rt treatment should consist of client-, 
Was is case, child-centered play therapy. It 

also predicted at this time that removal of 
Kine o tional problem would result in a 
aneous improvement in speech. 


beta 
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Description of Treatment 


Two therapists took part in Johnny’s ther- 
apy which consisted of forty-one play therapy 
interviews extending slightly over one year. 
The play sessions took place in a standard play 
therapy room. 

Because it was virtually impossible to under- 
stand Johnny, emphasis was placed on helping 
him perceive that he was accepted by the thera- 
pist. This is an aspect of therapy given em- 
phasis by Landsman [3]. An effort was made 
to show him that he was still liked and accept- 
ed even if his frequent limit-breaking could 
not be. 


A brief description of the pattern of the first 
several sessions provides a contrast with the 
last two sessions: In the first several sessions 
Johnny’s behavior followed a consistent pat- 
tern of aggression and destruction. In each 
session, after a brief period of examining the 
toys, he would begin to laugh and yell with 
apparent glee as he systematically put the room 
into shambles. 

‘The last sessions were spent in talking to 
the therapist about the things he was doing as 
he played constructively with blocks, pounded 
nails in a two-by-four, and painted. In the 
last session, he built a sailboat while discussing 
the fact that he wasn’t coming to therapy any- 
more. At one point, he reminded the therapist 
that he hadn’t brought more paint as he had 
promised he would. When the therapist sug- 
gested that maybe Johnny was a little angry at 
him for not keeping his promise he replied, 
“No, that’s all right.” At the end of the ses- 
sion he shook hands and said good-bye with no 
signs of difficulty. 

This nonquantitative observation of the im- 
provement in therapy is supplemented by the 
more objective phonetic analysis made of 
Johnny’s speech by the speech therapist. The 
before-analysis was made in one of the early 
diagnostic interviews. The other was made 
from a recording of the last play session. It 
must be emphasized that the phonetic analysis 
was made by a speech therapist who had no 
part in the treatment. 


The Speech Therapist’s Analysis of Speech 


The before-analysis was as follows: his 
speech is garbled and unintelligible; he seldom 
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attempts to speak. At its clearest, his speech 
shows the following omissions and substitu- 
tions in all positions: omissions: s, z, sh, zh, 
tch, dzh; substitutions: p for l, w for r, f for 
th, v for th; k and ¢ are used indiscriminately 
as are g and d. Most often his speech consists 
solely of vowel sounds.” 

The after-analysis was as follows: he initi- 
ates speech freely and frequently, he is almost 
always completely intelligible and only the fol- 
lowing errors still occur: s and z are substi- 
tuted for sh, zh, tch, and dzh. P is substituted 
for / in the medial position, and w for r in all 
positions. 


Table 1 


Substitutions and Omissions Usually Made in 
Speech Before and After Therapy 


Speech errors Before After 
Omissions 6 0 
Substitutions 6* 10+ 


*Counting indiscriminate use of K and T, G and D. 
{Counting all possible combinations of substitutions. 


An example of the way Johnny moved from 
omission-to-substitution-to-correct-sound would 
be his speech development on the word show. 
At first he said, “ow it to me”; then, “sow it 
to me”; and will soon (we predict) be say- 
ing “show it to me.” 

The social worker reported that both his 
teacher and his foster mother had noted and 
commented on his improved behavior and 
speech. Coincidental with the last several ses- 
sions of therapy, Johnny was being prepared 
for permanent placement in another foster 
home. This step was now believed practical 
because of his considerable improvement. 


Discussion 


As Van Riper [7] points out, in the develop- 
ment of speech the first sounds mastered are 
the vowels, then the labials, then the dentals 
and gutturals, then the complicated lip and 
tongue sounds, then the blends. When Johnny 
was first seen, his speech had stopped develop- 
ing at the vowel and labial level. This is ap- 
proximately the three-year-old level indicating 


that Johnny’s speech had developed little in the 
last five years: 


H. J. Dupont, T. Landsman, and M. Valentine 


As shown in Table 1, when last seen he had 
only the sh, zh, tch, dzh blends, and / and r to 
master. The disappearance of omission and the 
increase in substitution show, as the speech 
therapist reported, that he was more motivat- 
ed to speak as therapy progressed. This change 
in motivation to speak is considered a basic 
factor in the development of Johnny's speech. 
As is generally agreed, speech is learned and it 
is therefore important that it be attempted and 
practiced. P 

Adequate control is a very great problem 1n 
studies of this type. Certainly we do not ain 
approach control of the many variables in the 
present study. If we were certain that Johnny $ 
speech was due to emotional maladjustment 
and if we could be confident that no other 
factors except the therapy relationship were 
operating to help Johnny change, then ot 
might conclude with some confidence that ena 
apy without speech re-education is adequa s 
treatment for delayed speech. All that can : 
said, however, is that it certainly appeared > 
though Johnny’s speech difficulty was ne ° 
his negativism and aggression and that as A 
as we knew there were no other changes ie 
Johnny’s life except his relationship with ia 
therapist. If Johnny's speech remained g 
tremely retarded for five years only to R 
very much during the one year he was e 
a play therapist, we can at least be wage 
of the therapy as a possible contributor eesti 
improvement. We believe that Johnny’s T in- 
improved automatically as he became we in 
tegrated as an organism and more ee hat- 
interpersonal and social interactions. bserv- 
ever the contributing factors, it is an J with 
able fact that Johnny’s speech improve 
out any speech instruction. e cases 

It is dangerous to generalize from on force 
but the results of this study tend to re-€" 
the hypothesis that child-centered theraP tment 
out speech instruction is adequate trea addi- 
for some cases of delayed speech. Mary. ones 
tional studies, more thorough than t dat? 
will have to be completed before enous rese” 
will be available to prove or refute tbe P 
hypothesis. be 

The results of the study seem to e 
able toward the claims of client-cente™ aspect? 
apists regarding the growth-releasing ; s 
of client-centered therapy, but these € 


y wit 
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by no means proved. The results of the study 
Seem to indicate that therapy can take place 
even when language communication is difficult 
and verbalized feelings are at a minimum. In- 
dicating to the child that he was accepted, even 
when not understood, was apparently adequate 
i carry the therapy. This is a point made by 
aon [3] and Rogers [4] both of whom 

->S tae Importance of accepting the clients’ 
attitudes and feelings even though limits may 


ave to be set on his behavior, especially in the 
case of children. 


Summary 


to rie foregoing report we have attempted 
as a = and evaluate child-centered therapy 
ieee Treatment method for delayed speech 
a Aine ational disturbance is considered 
ln a factor. From the description and 
Were indi one case the following conclusions 
icated : 
indicates therapist's observation of the child 
Ment 7 improvement in emotional adjust- 
and intelligibility of speech. 
the bee E ee by phonetic analysis, of 
thae S before and after therapy indicates 


at z . 
st '™Provement occurred without speech in- 
Tuction 


consi The results of the study are in general 
istent with the point of view held by 
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Backus and Beasley [1] except that we would 
emphasize the importance of being child 
centered rather than speech centered. 

+. The results tend to re-enforce the hy- 
pothesis that child-centered therapy can be ade- 
quate treatment for seme types of delayed 
speech. The potential value of additional re- 
search on child-centered therapy as treatment 
for delayed speech instead of speech-centered 
therapy is demonstrated by this study. 
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Response to the Human Face as a Standard Stimulus 


Ernst G. Beier, Carroll E. Izard, Charles D. Smock, 
and Rolland R. Tougas 


Syracuse University 


In his investigation of the underlying as- 
sumptions of the TAT and related projec- 
tive techniques, Lindzey observed, “Although 
little effort has been made to explore the vari- 
ations in fantasy productions between many of 
the important groups of our own society, it is 
quite widely accepted or expected that these 
differences exist. Even such an important 
cleavage as that between male and female has 
been little explored so far as TAT behavior 
is concerned, while such variables as socioeco- 
nomic status, Occupational role, and ethnic 
group-membership have also been of slight 
interest to most investigators” [7, p. 17]. His 
thoughtful analysis emphasizes the importance 
of research in this area. Investigations at- 
tempting to differentiate among the reactions 
of various age categories and sexual groups 
to a standard stimulus may indeed serve to 
help us to obtain More refined data. 

Numerous studies, in the Past, have been 
devoted to problems of differential reactions 
utilizing the human face as a standard stim- 
ulus. For example, the importance of the face 
as the mediator of expression, of interpersonal 
Tesponsiveness, and of overt contact with the 
world at large is generally recognized, Fur- 
ent of emergence of social 


e infant, it is likely that the 
face of the moth 


life eatures social 
Y an infant's exclusi 


face, “Th 


shining objects, or a live cat” [1, ahaa 
Machover [8] in establishing the ra enter 
for the interpretation of drawings of a p eae 
sees the face (or head) as the most wie Te re- 
tive part of a person. “The face ma ee 
garded as the social feature of the ae ie 
k and is the most expressive r of 
the body” [8, p. 40]. Further, “The pore 
the adult is the most important organ re" [8, 
to the emotional security of the child 

p. 39]. sama 

Recognition of the importance of the titud- 
face as stimulus in social functioning, eau 
inal reactions, and early sensitization a ts 
ly, led several investigators into differ values! 
rections in search of its ning “have 
Landis [6] and Frois-Wittman [3 odi 
used the human face in the study of 10] have 
qualities, the social psychologists [ ses all 
used it as a stimulus to elicit cern oe on 
Szondi [2] bases his projective Ce nel 
value judgments about photographs © igh th 
faces, to mention only a few. a 
use of this medium, important resu Ae 
derived but additional basic knowledge 
seem desirable. 

The present Paper is a report on 
designed to investigate two basic lus 
related to the human face as a stimu = 
first problem is one of cultural preferen at 
the second that of differential reaction o 
two sexes to the stimuli. For paro ajea 
present study, the term cultural ble us has 
intimates the general meaning a Pe wit 
to large numbers of individuals nE in ; 
the boundaries of a particular socia culture 
illustrative application of the cc 1 
preference may be found when eae oul 
facial structure of a movie star; le în oe 

s a e for 
predict that a majority of ae anst 
culture would register a “like” resp 


wer 
ou d 


an 
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such a picture. Again, it is known that a large 
number of persons in our culture prefer the 
photograph of the only young face in the 
Szondi pictures, Neither of these facts gives 
us enough information to formalize our 
knowledge about the individual who has re- 
Sponded in such a way. In the present study, 
Per was made to throw more light on 
fe es of cultural preferences. Specif- 
able Saas cultural preferences are observ- 
plintoers a we break down a large sample of 

h “PAs Into various age and sex groups? 
divans x and large, the feeling toward 
People ont older people, those of younger 

©, toward males and toward females? 


ee senting to as highly structured a 
arge ii he human face conceivably conceal 
tween ee differential responses be- 
sent Study S oia female subjects. In the pre- 
reaking i son possibility was investigated by 
of male tie the total sample into subparts 
erential « a emale subjects. Accordingly, dif- 
Brouns n Tesponses to varying age and sex 

i ps could be determined directly. 
stimul ee re argued that in such complex 
individual a hotographs of human faces, the 
e Specifi pee would be more important than 
hat eee P to which it belonged and 
Such hoda toe could not be made from 
that ¢ 3 ags. It is here contended, however, 
aS the les selection of pictures as well 
Se number of pictures used are like- 


Y to 
Counteract these difficulties. 


Procedure 


regan order to obtain answers to the questions 
ences, mn (a) the nature of cultural prefer- 
SPonseg b (2) the quality of differential re- 
Otogra ie the sexes, a large number of 
a Ps of various sex and age groups 
female on and presented to male and 
Purposes on for preference ratings. For 
© Possible analysis of the data, it would then 
8raphs iit to break down the stimulus photo- 
X and a Subgroups according to age and 
e Ivide the subjects into male and 
uh; C OUPS. 
1 s. The sample? consisted of 45 males 


and 31 
5 “males enrolled in two sections of a 


Th 
t . Wri : . . ze 
a Dr, i ters Wish to express their appreciation 
& his nae McKee for his cooperation in mak- 
Sses available for this study. 
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general psychology course at Syracuse Uni- 
versity. The age range of the subjects*was 18 
to 28 with a mean age of 20.41 years. 

Selection of photographs. From a pool of 
over 1000 pictures of human faces, gathered 
from a variety of sources such as journals and 
yearbooks, a sample of 250 was selected. Four 
clinical psychologists served as judges. Selec- 
tions were made on the basis of the following 
criteria: (a) full-face view; (4) nonemotion- 
al expressions (no laughter, anger, or fear) ; 
(c) equal numbers of males and females; (d) 
age groups to cover normal life span; and (e) 
pictures rated unequivocally by the four 
judges were excluded, to obtain maximum 
differentiation. 

The full-face view was chosen in order to 
equate the photographs according to structure. 
The lack of a specific emotional expression 
was chosen as a selection criterion because it 
was felt that certain emotional qualities in a 
face might introduce unaccountable variables. 
The prejudgment of photographs was under- 
taken to eliminate such pictures as movie stars 
and beauty queens. It was felt that this type 
of picture would be chosen unanimously and 
thus preclude differentiation. The final pic- 
tures chosen reflected certain categories, divid- 
ing the photographs into younger, peer, and 
older age groups. 

Table 1 presents a distribution of the se- 
lected photographs of human faces according 


to age and sex. 
Table 1 


Distribution, According to Age and Sex, of Sample 
of Photographs of Human Faces 


Age Range 
Sex 1-3 416 17-30 40+ Totaly 
Male 29 75 19 123 - 
Female 28 72 22 122 
Infants 5 5 
Totals $ 57 147 41 250 


Administration. The photographs were at- 
tached to a strip of tape in random order and 
then projected on a screen by a standard 
opaque projector. The size of the picture and 
the fixation point were kept constant. The 
screen and seating arrangement were so de- 
signed as to present equal Opportunity for 
viewing, and minimizing and equalizing pos- 
sible distortions. Subjects were presented each 
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picture for five seconds (timed), during which 
interval judgments were to be made and their 
responses recorded on the answer sheet, as per 
the following instructions: 


We have here a series,of 250 portraits of people's 
faces. Obviously, when we are confronted with a 
stranger, looking at him and at his face particu- 
larly, we get certain first impressions about the per- 
son. In this research, we are seeking for your first 
impression. We will present you with the portraits 
of 250 individuals and some of them will impress 
you as real likeable people whose company you 
would appreciate. Some will impress you as people 
you wouldn’t care to meet or associate with at all. 
Remember, we want your first impression and that 
we recognize that your first impression would be 
modified if you knew the person. In between the 
more extreme likeable and not liked faces, you will 
find many faces that will impress you as either just 
o.k. or mildly disliked, both pretty indifferent really. 
On the answer sheet, we want you to mark A for 
the very likeable; B for the mildly likeable; C for 
mildly disliked; and D for the definitely disliked. 
You will have 5 seconds to judge each picture. Each 
picture must be judged. In other words, each pic- 
ture should be rated either A, B, C, or D. Remem- 
ber: A: a very positive yes; B: just yes; C 


no; D: very definitely no. Remember: 
sion only, 


: just 
First impres- 
The time is short—only 5 seconds in 


which to glance at the picture and then to record 
your answer. Are there an 


y questions as to what is 
to be done? 


All responses were recorded on IBM answer 
sheets and machine scored. 


In analysis of the data, A and B 
were combined as “likeable,” 
Categories were combined as ‘ 
further breakdown of categori 


categories 
and C and D 
‘dislikable.” A 
es would yield 
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x P ikp” “dis- 
an analysis of the intensity of “likes a = 
likes” but is not considered part of the P 
ent study. 


Table 2 p 
A > Males ar 
Distribution of Preference Ratings by Males 
Females on Test and Retest 


S31) 
5 re 1( N31 
Measure Male (N45) T emale( Dislike 
Like Dislike Like 
975 2975 
Test 6595 4655 4775 ain 
Retest 6731 4519 4778 


arth tot 

A retest yielded a frequency distribution 
preference ratings as shown in Table 
unpublished dissertation [5] has indicat fot 
essential stability of preferential ratings 
pictures of human faces as stimuli. 


d the 


Results 


eS) 

The demonstration of cultural a 
as defined in this study, may be der a data 
an analysis of the data in Table 3. Je an 
presented are for the total sample of Pesenti 
female subjects combined, and are rep” 
tive only of the 17-30 age group. . ion of 

For the group as a whole, insp ae roups 
Table 3 reveals that only two age-se* F hese 
fail to be differentiated from each other -g 
are (a) peer males (17-30) from a Sl a 
(40+), and (4) older males (40+) a di- 
er females (40+). In effect, the oe ; ne old- 
vided the categories into two groups; 2 
er than themselves and the other young at a8? 
themselves. This finding emphasizes t 


Table 3 

Chi-Square Values Comparing Ratings of Sex and Age Groups With Each Other (f=). idet 
Young Young Peer Peer Older pemal 

Male Female Male Female Male aot) 

Infants (1-3 — $4778 16.76% 186.29% 126.72* 157.58" 79058 
Young male (4-16). - 10.534 338.99% 171.39% 207.38" 92.68" 
Young female (4-16)... assy papa 294.56" 3 734 
Peer male (17-30) _. i f * 08 0 15" 
Peer female (17-30) a 24.62" ; 71 
Older male (404). l ; 


level of confidence, 
hi square: 


chi square: 10.885, 
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1s an important factor in the measurement of 
preferences relative to the human face. 

lhe peer-age female category, interestingly 
enough, was placed with the younger group, 
and the peer-age male category with the older 
group. Thus, when considering the peer-age 
Category, age and sex both seem important de- 
earn in preferential ratings, whereas in 
W a a combined, age alone appeared 

e important factor. 


r Table 4 
ultural Preferences for Age and Sex Groups 
for All Subjects 


Ratings of All 
Subjects 
x Like Dislike xe $ 
nfants (1-3 
(N: 5) ) 334 46 221.62 .001* 
Young male 
(4-16) 5 
16 A .001* 
(V:29) 45 559 549.67 
oung female 
(4-16) 
1677 1 707.27  .001* 
:28) 45 7 
cer male 
(17-30) é 
W375) 2956 2744 8.13 01 
cer female 
(17-30) 
.001* 
N72) 3213 2259 166.56 -00 
Older male 
(40+ 
$ i02; * 
(W219) 743 801 5.78 
Older femal 
(404. 
.001* 
N:22) 802 870 15.51.00 
*Signi 
this ra at the level of confidence established for 


S 


n enificant] 

(older ica that in two of the seven groups 
Tesponses n° and older female), the “dislike” 

While jn oe larger than the “like” responses, 
response the other five categories the “like 

as are larger. These data could be in- 

as indicative of a cultural preference 


he subjects professed “liking” for 


ETPrete 
Tating, 


129 


photographs of human faces of individuals of 
peer age and younger than themselves, while 
they professed a “disliking” for faces of indi- 
viduals in the category older than themselves. 
Additionally, large differences were also noted 
within the five “like” “categories. This sug- 
gested the possibility oï ranking the relevant 
age-sex categories in order of the observed 
preference. This study, however, was not de- 
signed for such close differentiation, and pre- 
cise ranking could not be established. The ap- 
proximate ranking given below might be sug- 
gestive of further hypotheses. The ranking 
was obtained by the following formula: 


(Like responses) - (dislike responses) 
X 100 


Number of pictures in each category 


In this manner, a “like” per picture score was 
obtained, as shown in Table 5. The ranking 
would indicate the approximate position of 
each category in terms of cultural preference. 


Table 5 


Preference Scores for Age Groups 


Age group Preference score 
Infants (1-3) 57.6 
Young female (4-16) 21.5 
Young male (4-16) 19.0 
Peer female (17-30) 6.5 
Peer male (17-30) 1S: 
Older female (40+) —3.10 
Older male (40+) —3.05 


The contrast in “liking” expressed for chil- 
dren as opposed to the “disliking” directed 
towards adults is indeed striking. Further in- 
vestigation of this phenomenon would seem in- 
dicated. 

Inspection of Table 6 tells us that in four 
of the seven categories differential responses 
were found. In their response to infants, to 
young males, to older males, and to older fe- 
males, the male subjects respond with a sig- 
nificantly different Like:Dislike ratio than 
do the female subjects. In their responses to 
peer-aged men and women, however, as well 
as to younger girls, the male and female sub- 
jects do not differ from each other. For all 
categories combined, men react differently 
from women in a statistically significant man- 
ner. These findings lend support to our hy- 
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Table 6 


Variation of Preferences for Age and Sex Cate- 
gories of Male and Female Subjects 


Males Females 
Dis- Dis- 
Like like Like like x? p 
Infants 
(1-3) 189 36 145 10 7.86 .01 * 
(N:5) 
Young male 
(4-16) 930 375 715 184 19.22 .001% 
(N:29) 
Young female 
(4-16) 982 278 695 173 1.40 .25 
(N: 28) 
Peer male 
(17-30) 1741 1634 1215 1110 25° .60 
(N:75) 
Peer female 
(17-30) 1894 1346 1319 913 22 .60 
(N:72) 
Older male 
(40+) 420 435 323 366 4.56 .05 * 
(N:19) 
Older female 
(40+) 439 551 363 319 12.77 .001* 
(N:22) 
Total N: 17.35 .001* 


“Significant at the level of confidence established for 
this study. 


pothesis that caution should be exercised in 
attempting to establish common norms for 
both men and women in reference to human 


faces and possibly to all standard projective 
stimuli. 


Discussion 


These preliminary findings are reported here 
because they seem to be of sufficient impor- 
tance to throw doubt on some of the basic 


assumptions underlying some present- 
of the medium un 


cultural preference 
ing in the qualitati 


day uses 
der consideration. Definite 
s were shown to be operat- 
ve responses to age and sex 
groups through the utilization of human faces 
as stimuli. The subjects showed more “liking” 
for faces of peer-age females and younger peo- 
ple, and less “liking” for faces of older peo- 
ple and Peer-age males. It becomes clear that 
a, formation will have to be made 


vai order to fully understand an in- 
dividual ’s responses. jii 
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These findings seem to mirror a oilan 
pattern when we discover that older peop: © 
are the only categories which received a ma 
jority of “dislike” ratings. It reflects to some 
extent the role of the older individual in out 
society and the sympathy he might expect ne 
a younger group. It is, however, altoget = 
likely that other cultures would demonstrat 
somewhat different patterns of préferenc™ 
Further, it is interesting to note that the gt 
subjects responded differently from the a 
male subjects to almost all age-sex eigen 
with the exception of that representing ere 
own age. Is this an artifact, or have we is 
an implication of some specific nee : 
the development of the cultural-sexual role 
an individual? Rds 

It was also discovered that responses tO = 
man faces by and large differentiate men oe 
women, which indicates that separate panes 
for the sexes should be considered in T 
to understand the individual’s responses york 
thoroughly. What remains hidden within a ae 
mative data which ostensibly differentiate a 
sex from the other can only be hinted at ne 


` he s07 
It would seem possible, however, that ba the 
cial and sexual roles one learns to adop "an 


sources and direction of identifications, rë 
the elements of one’s self concept may fat 
flected in qualitative responses to human these 
Machover’s monograph [8] alludes i jew. 
potentials from an interpretive point of Vae's 
That certain faces give expression tO 
canalized aspirations or expectancies an 
cue off subjective wishes or identific et 
would seem pertinent to such age-sex i 
entiations as were found in this study. 
would seem to embody the transferring an 
previous experience a host of stereotypes suc 
long-standing conditioned responses tO ° 
features as the expression, age, and spe 
face. For example, young females have © 
be pretty and decorative to comian y i 
attention. Again, the need to please ° p the 
frequently observed in them. Boys, J strides 
other hand, are expected to make rap! powe" 
in development of physical and sexua r þe- 
The influence of such cultural trends needs 
havior and personality development -op 
clarification. An unpublished dissert@ en $0 
one of the authors is attempting tO oP tional 
consideration the meaning and asso‘ 


r 


to 

vid 

hers 
tl 
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content behind ratings of like and dislike for 


Aiman faces as a further step in this direc- 
ion. 


Summary and Conclusions 


An experiment was designed to investigate 
Ahan of cultural preferences and sex 
the ea i? thie response of young adults to 
Feet fi tt pace as a standard stimulus. Sub- 
sity stude ae study were 76 Syracuse Univer- 
ranged ig +5 male and 31 female. They 
being 3 age from 18 to 28, the mean age 

ng 20.41 years. 

In orde 
tural pref 


th 


r to investigate the presence of cul- 
2 Preferences to human faces, a series of 
oth oe covering infancy to old age in 
total sth ge shown. The responses of the 
through ea aera statistically evaluated 
mination ; chi-square technique. For deter- 
males ey ey differences, the responses of 
Statistical] emales to each age-sex group were 
m tly analyzed by the same technique. 
cultural peed revealed the presence of clear 
age et references for faces of people of peer 
cantly younger, These were rated signifi- 
more “liked” than “disliked.” 

Westionabla o4 of normative data was shown 
ÀN the J; ¢ through the demonstration, with- 
mits of the particular sample em- 

» Of differential responses by males and 


males 
ent a of the same age to pictures of differ- 
Re-sex groups. 
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The limitations that these results impose on 
normative data in response to standard stim- 
uli and possibly all projective stimuli were 
briefly discussed. 
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Communication 
Clinical 


David 


Occidental 


Developments during the past few years 
in the fields of counseling and psychotherapy 
have added immensely to our understanding 
of the nature of communication in the thera- 
peutic situation, and of factors which en- 
courage or inhibit communication between 
patient and therapist. We have come to regard 


good communication as prerequisite to good 
psychotherapy. 


The purpose of this Paper is to suggest 
that the insights which we have gained here 
also have implications in the procedures em- 
ployed in diagnostic psychological testing. In 
this area we find that traditionally the empha- 
sis as far as the interpersonal relationships 
are concerned has been upon rapport rather 
than upon communication as such. In eval- 
uating the validity of results of such testing 
we have always been concerned with whether 


good rapport existed between subject and ex- 
aminer or whethe 


subject seemed to 
the immediate int 
have assumed that 
for valid testing, 


Most Psychom 
the h i 


r the performance of the 
be blocked by the nature of 
erpersonal relationship. We 
good rapport was necessary 


and Rapport in 
Testing’ 


Cole 


College 


1ce 
A S ai importa! 
jective techniques it is of great 1mp 


s 
that the subject feel free to convey wal 
responses which occur to- him S on the 
conscious screening or censoring, ant are D 
other hand that we get a clear the sub- 
what the particular response ehi bly many 
ject is attempting to describe. I Se iit the 
have had the experience in administ h a 
Rorschach of being confronted a Ø 
sponse wherein it was very difficu he 
certain from our subject just an i wit 
using the blot material. We wao ether the 
the unpleasant speculation as to * ei 
apparent fault in perception was us 
own. Again in intelligence testing i 
utmost importance that if we are net from 
to get the qualitatively best performa „munic 
our subject, that a high level of con intell 
tion exist. In general, persons doing lowed 
gence testing for all age levels have gost’ 
along the lines of rapport building D a the 
by Terman and Merrill in the A ipate 
Stanford-Binet: that “nothing ater ne 
More to satisfactory rapport than = that ue 
child encouraged,” [1], and further en 


out 


as- 


nu 


5 an 
general it is wise to praise frequently fr and 
erously, but if this is done in ne ae its P! g 
stilted a fashion it is likely to defeat " ‘tin 


sta 
Pose.” Taking these statements aS : inject? 
Point, and despite the qualification: g intel 
by Terman and Merrill, persons ie pre, 
gence testing have been prone to = nge WE 
their chief medium of verbal exc aa pe 
their subjects, praising profusely qualitat, 
times with too little relation to the ga su 5 
performance of the subject. vee a so? 
failed an item, they followed Ter it.” 
gestion and made “some excuse for 


Communication and Rapport in Clinical Testing 


It is particularly to this approach to rapport 
building in intelligence testing that this paper 
1s addressed. Our research in psychotherapy 
has suggested a few things about the value of 
reassurance in facilitating communication. We 
have found that in many cases, reassurance, 
or an evaluative response on the part of the 
therapist, actually serves as a barrier to further 
panmunication, The fact that the response 
ue rape may indicate that all re- 
x o wi ha so evaluated, and the client is 
of Seven the defensive, setting up a process 

lar tie his statements more carefully 
aa resenting them to his critic. { his same 
adtninistr, all probability works during the 
With a Taition of an intelligence test. Here, 
tive, ‘ire Purpose more often openly evalua- 
enter ~~ find that many subjects 
sive, Onl ie environment on the defen- 
antile ngA ea ament or the emotionally in- 
is Unable So lacking in autocriticism that he 
is respi to judge qualitative differences in 
Uccess ah and is unable to discriminate 
hasty ` r a failure in some test items. T hus, 
with K e may often go in conflict 
aS seen ie quality of the responses 
dence of 3 i subject, and increase the inci- 
The a ocking and refusal to respond. 
Same processes which reduce blocking 


$ 


& our subject's performance, we make 
Situation ee to understand what the 
Municate Wans to him, and attempt to com- 
raise the is him this awareness, we may 
Ret a See of communication, and hence 
Person a valid picture of what kind of a 
testing i pen working with. Our aim in 

aS Tar as the establishment of rapport 


nce of our subject and to communi- 
5 is um our appreciation of his situation. 
Stration aPproach may influence our admin- 
Umbe of standard intelligence tests in a 
Mitial hen > With some subjects, the 
hengi A faction to the test will be to be appre- 
Indicate on and defensive. They will 
behaving this to you through their remarks and 
reaction as they prepare for the test. Our 
letting May recognize this apprehensiveness, 

subject know that we appreciate 
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how he feels, and can understand why he 
might feel that way. His comments may be 
intrapunitive, indicating a doubt in his own 
ability, “I always do lousy on these things,” 
or may be extrapunitive, “Are these tests 
really what they are cracked up to be?” He 
may communicate through behavior more than 
through words, by sitting rigidly in his chair, 
arms tightly folded, or by conspicuously and 
suspiciously eyeing the stop watch. Reacting to 
such feelings as were just cited with comments 
such as “you are afraid you never do your- 
self justice on a test,” “you think test scores 
aren't the whole story,” “you seem a little 
tense,” or “you think the timing may bother 
you,” can do much to clear the air and reduce 
the hierarchical structure which too often 
exists during testing. 

In proceeding through the test, the subject 
usually first encounters easy items. Various 
reactions may result. One will find this situa- 
tion relieving; he is glad that he is able to 
handle the initial material. This reaction may 
be recognized; we may indicate that we 
understand that he is happy to find easy 
going. Another subject will react to easy items 
with hostility. He is insulted that we should 
feel such material was worthy of his abilities. 
This too can be recognized and accepted as 
a reasonable reaction from the person con- 
cerned. As the testing proceeds most subjects 
will become aware that the items are more 
difficult, and that they are finding it more of 
a problem to produce correct responses. They 
will react to this in accordance with their own 
personality and the nature of existing rapport, 
blaming you, blaming the test, blaming them- 
selves, or accepting the fact that the test is 
now beginning to separate the men from the 
boys. In the interest of good rapport and 
communication it is good to accept these atti- 
tudes as expressed, to let the person know that 
you realize that the items are difficult, that 
he is uncomfortable (if this is his feeling), 
and that he will be glad to get out of hot 
water. 

Because most intelligence testing makes an 
attempt to reach the point where the subject 
can no longer answer correctly, the wide use 
of praise can easily lead to a situation where 
the examiner is confronted with the alter- 
natives of either abandoning his previous ap- 
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proach. with the obvious implication that 
praise is no longer deserved, or continuing 
to praise in situations where the subject him- 
self is aware that performance is inadequate. 
To attempt to draw a fine line between prais- 
ing the subject’s effort, and praising the re- 
sults of his effort, is probably often to exceed 
the discriminative capacities of both subject 
and examiner. 

The hypotheses and suggestions here pre- 
sented have proved useful in teaching rapport- 
building techniques to graduate students in 
testing courses during the past two years. This 
approach has been more productive of good 
rapport than resulted from other methods, 
As empirical evidence of the nature of the 
Tapport, students using these techniques have 
een conspicuously more successful in obtain- 
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ing subjects who are willing to be retesten 
on the alternate forms of the Binet an 
Wechsler. Inherent in this approach is respect 
for the person being tested and a recognition 
of the fact that his feelings are genuine ee 
enter into the testing situation. If what 
been found valid in one area of casa 
relations has validity in another area, ye 
such an attitude may be expected to oe 
communication, rapport, and thus aid in lity 
taining a more valid picture of the personali 
under investigation. 
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A Validation of Changes in Scores on the Index of 
Adjustment and Values as Measures of 


Changes in Emotionality ` 
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ac uy of the validity of the Index of 
Compared th aat Values [1], Roberts [2] 
Which were © emotionality of the Index traits 
traits “ic high ratings by subjects with 
used the ii ee low ratings. Roberts 
Criterion of x traits in free association and his 
è cael ee was response time. 
Bave fiers that the ratings the subjects 
Seives on the Index were valid in- 


Ices o 
t oe A 
Subjects, he emotionality of the traits for the 
á he present 
, 
in erts’ conclus 
fr “Motion 
OM test 


Study was designed to verify 
i ions and to investigate changes 
ality when changes in ratings occur 
to retest, 


Design 


Fig 
of Keneygtunteers students at the University 
justme Y, were administered the Index of 
eMester st and Values at the beginning of a 
Students. "mg the following week these 
of the Inde given, individually, the 49 traits 
Cre instrua In free association. The subjects 
© with ¢ Sted to respond as rapidly as possi- 
and reg cti ¢ first word which “came to mind,” 
a Chrono. times were measured by means of 
dtntation st and voice key. The order of 
each oud , the stimulus words was ran- 
The bject ai different order was used for 
dy “Se data k each of the two presentations. 
Sions, ere used to verify Roberts’ con- 


Ourt 
een 

A Weeks after the subjects had been 

Renche ys 
n wr A 

Wi fon esearch 

hitter m this fund h 

ovary) 


indebted to the University of 

Fund Committee. A grant-in- 

also like. made the study possible. The 

ble aj e to thank Glen E. Roberts for 
as assistant on this project. 


tested with the Index they were retested with 
this instrument, and during the following 
week they were retested with the free associa- 
tion test. 

Results 

Data from the first test. The data from the 
first Index and the first free association test 
were used to verify Roberts’ conclusions. 

The Index of Adjustment and Values re- 
quires that a subject make three ratings on a 
five-point scale for each of 49 traits. These 
ratings are arranged in three columns which 
have been designated by the Index authors as 
concept of self, acceptance of self, and the con- 
cept of the ideal self. A fourth score, called 
discrepancy, is obtained by totaling the differ- 
ences between concept of self and concept of 
the ideal self. The three analyses performed 
in this section related to the ratings on three of 
these scales. 

In the first analysis average reaction times 
were determined for each subject on the traits 
he had rated 4 or 5 and 1 or 2 on the concept 
of self. In this manner two distributions of 
50 averages were obtained. Each distribution 
contained an average for each subject. In all 
calculations, words on which blocks occurred 
or on which a subject had a reaction time in 
excess of 6.81 seconds (3 times the standard 
deviation of the distribution of mean reaction 
times of the subjects on each trait) were ex- 
cluded from the analysis. A test of the signifi- 
cance of the difference between the means of 
the above two distributions gave a ¢ of 1.111. 
This may be interpreted, at the .30 level, to 
mean that there is insufficient reason to assume 
that the two distributions are not random 
samples from the same population. 
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‘The data were next analyzed for differences 
in acceptance of self. Average reaction times 
were calculated for all of the traits rated 1 or 
2 (rejection of self) and 4 or 5 (acceptance of 
self). Again, this yielded two distributions of 
50 averages, and eaich distribution contained 
an average for each sitbject. A comparison of 
the mean difference gave a ż of 1.88 which is 
significant at the .06 level of confidence. 

The third analysis was for discrepancy 
scores; the differences between the concept of 
self and the concept of the ideal self. Average 
reaction times were determined for each sub- 
ject on all traits which shov 
and these averages were compared with the 
average reaction times of traits which showed 
a discrepancy. This comparison gave a ¢ of 
1.80 which is significant at the .08 level. Table 
1 summarizes the data from the three analyses. 


ved no discrepancy 


Table 1 
Comparison of Free-As, 


sociation Reaction Times for 
High and Low R 


atings on Concept of Self, 
Acceptance of S; 


elf, and Discrepancy 


Rating 


o 
5 
5 
w 
© 
a 
n 


Mean 


1,2 2.60 
09 1.11 30 
4,5 2.70 £ 
Acceptance of self 
1,2 2.80 
08 1.88 06 
4,5 2.65 
Discrepancy 
2.62 
05 1.80 08 
1,2,3,4 2.71 
' Test-retest data. Test-retest data were an- 
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age reaction times were determined n ia 
first and second tests on traits ee 
rated higher on the retest than on the first p 
and the same averages were obtained for a 
which were rated lower on the Teles of 
the first test. Thus, four ane 
average reaction times were obtained, see ie e 
distribution contained an average for cach os 
ject. Similar distributions of averages war 
calculated for test-retest ratings on seata 
of self and discrepancy scores, and, thus, i The 
of twelve distributions was obtained. ad in 
means of these distributions are Tae 
Table 2. Subsequently, Index m a Le test 
were higher on the retest than on the ak de- 
will be designated “+,” and those whic 
creased on retest “—.” pwn distri- 
" oa “Lr and Tea 
Each of the pairs of “4 Miistribution ° 


butions were used to give a ribu- 


differences. The means of these six a 
tions of differences are also contained in change 
2. These mean differences represent the : fro 
in reaction times for “+” and “—” inner re 
test to retest and they show that ayeme on 
action times were faster on the retest thé 

the first test. 


Table 2 . fimes to 
Means and Mean Differences of Reaction ange 
Trait Words When Reaction ‘Times ae gett 
According to Increase or Decrease m 
on Traits from Test to Retes 


——- an oes 
Mean of means g Jirorent 
Rating Ist. test __ 2nd te 
0 
Concept of self 2.51 SH 
Increase (“4”) # 2.61 2.42 i 
Decrease ("=") + 2.70 , 14 
Acceptance of self 2.53 Za 
Increase (“+”)* 2.67 2.39 
Decrease City 2.66 24 
Discrepancy 2.53 wit 
Increase (“+-") # 2.77 2.50 w 
Decrease (“—”yf 2.61 ; 12 nif 
woh receiver ct of 
* Mean reaction times of words Te i first a am 
er rating on the Index on retest thar i 


vhich 
+ Mean reaction times of words as fir’ A 
rating on the Index on retest than eS) 


j : istributions of ca 
The above six distributio re used t° co 
three “+” and three “—,” we i 


an re 
os x z res. in 
late distributions of gain wre chang’ pro” 
represent the differences in t r traits 


t 
. 2 ” 
action times for “+” and 


ia 


Changes on the Index of Adjustment and Values 


test to retest. If the means of these gain scores 
are significantly different from zero, it may be 
concluded that changes in reaction time to “+” 
and “=” traits are significantly different. The 
ane estimated standard errors, #’s, and prob- 
abilities for the gain scores are presented in 


Table 3, 
Table 3 


Significance of Means of Gain Scores for the 
Three Index Ratings 


s 
5 
Paris 
Rating s$ 7 
ZE aS 
Ag aE ‘1 à 
email of self = ~12 10 1.20 30 
ee of self —14* 07 2.00 05 
is 
—<repancy 13 .06 2.17 05 
B 
antes en ef “rounding errors,” this mean does not 
ifferonces tY With the difference between the mean 


ces shown in lines 3 and 4 of Table 2. 
Discussion 


ne data confirm Roberts’ conclusion that 
measure an Adjustment and Values is a valid 
e i emotionality, at least as far as can 
associati ished by using reaction time in free 
be On as a criterion measure. f 
Tatin © data show, likewise, that changes in 
ES of concept of self from test to retest 
tionalie accompanied by changes in the emo- 
[27 4.¥ Of the traits for the subjects. Roberts 
Self do onstrated that ratings of concept of 
in emo Not involve distinguishable differences 
by tionality and his conclusion is supported 
sult which of this experiment. This is a re- 
differe, Might be predicted logically since 
Emotio ces in concept of self should not involve 
nality unless a discrepancy exists be- 


tWeen th 


En 
self ideal 


are 


€ concept of self and the concept of 
eca self or the subject is rejecting of 
rati use of his concept of self. Since differ- 
di es on concept of self do not involve 


i Cren . . . 
dicte © degrees of emotionality, it was pre- 


Self at changes in ratings on concept of 

Chan test to retest would not involve 

€Xpery 1 emotionality, The results of the 
Roba. upheld this prediction. 


z hig “rts demonstrated also that comparisons 
aid ab and low ratings on acceptance of self, 
the eo Sence or presence of discrepancy between 
Self, tnt of self and the concept of the ideal 

Wealed significantly different degrees of 
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emotionality. This conclusion was substantiat- 
ed by the present experiment. Since the vari- 
ables of concept of self and discrepancy are 
indicators of emotionality, it was predicted 
that changes in ratings on acceptance of self 
or changes in discrepancy scores from test to 
retest should be accomuanied by changes in 
emotionality. The data of this study support 
this hypothesis, and thus it may be concluded 
that changes in ratings of acceptance of self or 
discrepancy on The Index of Adjustment and 
Values are accompanied by changes in the 
emotionality of the traits for the subjects. 

The results of the study clearly demonstrate 
that when ratings are lowered from test to re- 
test, they are accompanied by decreases in free- 
association reaction time which are significant- 
ly greater than the decreases associated with 
ratings which are raised from test to retest. 
This is the opposite of what was predicted. It 
may be reasoned, though, that the ability to 
lower a trait rating on retest may be indicative 
of a lower degree of defensiveness, and it 
would be predicted that such a reaction would 
be accompanied by a decrease in emotionality 
and, therefore, by a decrease in reaction time 
to the trait in free association. 

Regardless of the reason, the data permit 
the conclusion that changes in trait ratings on 
the Index of Adjustment and Values from test 
to retest are accompanied by changes in the 
emotionality of the traits for the subjects. The 
lack of complete reliability of personality tests 
has usually been ascribed to sampling errors, 
errors of measurement, and perhaps to chang- 
es in the subject. This study has demonstrated 
that a statistically significant portion of the 
lack of complete reliability of the Index of 
Adjustment and Values in a test-retest situa- 
tion is due to changes within the subjects. 
These data offer further support for the as- 
sumption that the Index is a valid measure of 
emotionality and changes in emotionality, 


Summary 


At the beginning of a semester fifty volun- 
teer students were tested with the Index of 
Adjustment and Values and a free association 
test which used the traits of the Index as stimu- 
lus words. Fourteen weeks later the subjects 
were retested with both measures. + 

On the basis of the first tests it y-as ccter- 
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mined that Roberts’ conclusions regarding the 
Index of Adjustment and Values as a valid 
measure of emotionality were supported. 
From the test-retest data it was concluded 
that changes in trait ratings from test to re- 
test are accompanied by changes in the emo- 
tionality of the traits for the subjects and that 
ratings on the Index of Adjustment and Values 
are valid measures of changes in emotionality. 
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The Madeleine Thomas Completion Stories Test 


Eugene S. Mills 


Whittier College 


a the writer made a survey of fifty 
ters to = clinics and child guidance cen- 
allene TE the extent to which the 
was bein e Thomas Completion Stories Test 
of the T used in clinical practice. All but two 
iar with le reported that they were unfamil- 
or specifi e test and about half of them asked 
Tes ote information relating to the test and 
as been ation. A brief report [1] of this test 
further baie Previously, but it is felt that a 
respons, eport is warranted by the interested 

Th e to the survey questionnaire. 
Test aon Thomas Completion Stories 
ticle by M ) was first presented in an ar- 
e devel adeleine Thomas [3] in 1937. 
the clopment of the test was the work of 
<- J. Rousseau Institute and of the Psy- 
Laboratory of Geneva. Helmut 
clinical psychologist for the Child- 
Ospital in Los Angeles, made a trans- 
asita the test which has been used at that 
School CI nd at the Claremont Graduate 
Ence M laremont, California, under Flor- 
the y,-2teer. Using Wursten’s translation of 
°Xplorato items, the present writer made an 
NE it to T [2] of the test by administer- 
een th ty elementary school children be- 
the beg € ages of five and fourteen years. To 
t of the writer’s knowlege, this is the 


Only g 
cholopi dy of the test to be reported in a psy- 
cal journal since its publication in 1937. 


chological 
Ursten, ¢ 
n’s H 
lation o 


Te, 


Description of the MTT 


for te otiginator of the test offers as a basis 

the hypothesis that all im- 
Creation obeys a certain determinism 
Crea “stg ne can, when in possession of such a 
? infer the psychological causes from 
for pe] € SPrings. The MTT is a clinical tool 
teen (Sing this creativity. It consists of fif- 
Condition ®® or items which relate to the family 

ns, school experience, and fantasy life 


ic 
rel 


of a fictitious little boy or girl of the same sex 
and age as the child being tested. Each story 
poses a problem which is left in suspense, and 
the child is asked to resolve that problem; 
that is, he is asked to finish the story to his own 
liking. The fifteen stories follow: 


1. A boy (or girl) goes to school. During recess 
he does not play with the other children. He stays 
all by himself in a corner. Why? 

2. A boy fights with his brother. Mother comes. 
What is going to happen? 

3. A boy is at the table with his parents, Father 
suddenly gets angry. Why? 

4. One day Mother and Father are a bit angry 
with each other. They have been arguing. Why? 

5a. Sometimes he likes to tell funny stories to his 
friends. What kind? 

5b. Sometimes he likes to tell funny stories to his 
parents. What kind? 

6. A boy has gotten bad grades in school. He re- 
turns home. To whom is he going to show his re- 
port card? Who is going to scold him most? 

7. It is Sunday. This boy has been taken for a 
ride with Mother and Father. Upon theif return 
home, Mother is sad. Why? 

8a. This boy has a friend whom he likes very 
much. One day his friend tells him, “Come with me, 
I am going to show you something, but it is a secret. 
Don’t tell anybody.” What is he going to show 
him? 

gb. This boy has a friend whom he likes very 
much. One day his friend tells him, “Listen, I am 
going to tell you something, but it is a secret. Don’t 
tell anybody.” What is he going to tell him? 

9a. It is evening. The boy is in bed, the day is 
ended, the light turned off. What does he do? 

9b. What is he thinking about? 

9c. One evening he cries; he is sad. What about? 

10. Then he goes to sleep. What does he dream 
about? 

11. He wakes up in the middle of the night. He 
is very much afraid. What of? 

12. He goes back to sleep, and this time has a 
very nice dream. A good fairy comes to him and 
says, “I can do anything for you! Tell me whai you 
want. I am going to touch it with my magie rod 
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and al! you may wish for is going to come true!” 
What does he ask for? 
13. The boy is growing up. Is he anxious to be 
a big boy soon, or would he rather remain a little 
boy for a while? 
14. Among all the fviry tales that have been told 
him, which one does he: like the best of all? 


15. Do you remember when you were a little 
boy? What is the first thing that you can remem- 
ber now? 


Administration and Theme Analysis 


The MTT is administered in a room which 
is as free as possible from distracting con- 
ditions. After rapport has been established 
with the child, the examiner begins with 
words to this effect: “We are going to tell 
some stories. I will start them and you will 
finish them. It isn’t hard. You will see.” 
Then the examiner reads the first story in a 
slow, even voice and finishes with an ex- 
pectant attitude. If the child’s response is 
only perfunctory or seems to leave a great deal 
unsaid, the examiner uses a follow-up question 
or comment such as, “Why?” or, “And then 
what happened?” In this manner, it is often 
possible to extend the scope of the response to 
include highly significant material which might 
otherwise have been left unrevealed. The re- 
sponses are recorded verbatim. 

The MTT requires, on the average, about 
20 to 25 minutes for administration. This de- 
pends, of course, upon such factors as the 
speed of response, the length of the response, 
and the amount of resistance encountered; 
some children require only about 15 minutes to 
complete the items. 


There are, as yet, no well-established meth- 
ods for analysis of the MTT; however, 
methods for processing other types of projec- 
tive material seem applicable. The writer has 
used the following general approach with 
Some success. First, a survey of the test re- 
sponses is made, emphases and trends being 
noted. Second, each response is studied separ- 
ately. An attempt is made to determine the 
dynamics and orientation of the response (i.e., 
sibling rivalry, directed toward a younger sis- 
ter; parent-child tension, directed toward the 
mother). These themes are then recorded in 
a few words on the test form or on a separ- 
ate jxece of paper along with the story num- 
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ber. Third, the responses are then scrutinized 
for repetitions, unusual responses, and Te 
sponses which stand in striking contrast to 
the general theme developed in the test. 


: re then 
Fourth, the most important themes are pi 
studied in relation to any biographical ag 
ial about the child which is available. In 


way, it is often possible to discover ge’ 
significant facts about the emotional life i" 
the child in a relatively short time, depen : 
ing, of course, upon the skill and insight a 
the clinician, and the extent to which he et 
sires to analyze the test responses. | In as 
cases a selective use of certain items, a 
proved helpful, especially when the clini! 
suspects difficulty in specific areas of the chi 
emotional life. This flexibility would appear á 
be one of the major advantages of the te 
nique. 

With what ages is the test ef 
what kind of material is revealed 
The writer has found the test to be us 


fective as 
by its us! 
eful be- 


wit 


ren from eight to cleven years, i 

with many other tests, much of the ¢ nsive 

ness of the MTT depends upon the respo 

ness of the child being tested. rence 
In order of the frequency of aoa 65 

the writer has found the following Hlowind 

revealed by the MTT. The numbers to 

each theme refer to the stories W a 

to most effectively elicit that particu ul 


a. 
1. Manners and moral conduct—3, 8% i 
2. Fantasy life—11, 10. 
3. Parent-child tensions—3, 6- 
4. Parental discipline—2, 6, 96 
5. Anxiety—11, 15, 9c. 1, 96 
6. Social adjustment, good and bad 
7. Likes—12, 13. 
8. Parental conflict—4, 7- 
9. Sibling rivalry—2, 3. 
10. Aggression—1, 13, 9¢- 4 il. 
11. Home stability and instability—” 
12, Sex awareness—13, 8b, 9a. 3 
13. Parent-child understanding—” 
14. Escape—1, 8b. 
15. Fears—13, 11, 6. 
16. School conduct—1, 9b, 12. 1, 6 
17. Teacher-child relationships—" y 
18. Deep loss—15, 10. , y may a 
s which 


Other significant indication: 
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pear are resistance and distraction. While not 
directly revealing the nature of the child’s 
emotional life, these indications are often 
Significant when one is cognizant of the 
Specific story-items to which the child is re- 
sponding. 

It is hoped that this brief description will 
E to acquaint clinicians with the Made- 
ie Vhomas Test and perhaps stimulate 

rther research, 
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MMPI Profiles and Personality Characteristics 


H. Birnet Hovey 
Veterans Administration Hospital 
Fort Douglas Station, Salt Lake City, Utah 


This study is concerned with comparing ob- 
served personality characteristics of nonclinical 
individuals with profiles they produced on the 
Minnesota Multiphasic Personality Inventory 
(MMPI) [1]. Contrary to the usual proced- 
ure of comparing test results with groups of 
individuals selected according to certain be- 
havior criteria, this study started by grouping 
Persons according to test results, and then as- 
certaining what personality characteristics or 
traits appeared, a procedure similar to the one 
used in compiling An Atlas for the Clinical 
Use of the MMPI [2]. The population con- 
sisted of student nurses in practicum training, 
not because of a Primary interest in nurses, 
but because data for the most part were al- 
ready available and only waiting to be or- 
ganized and analyzed. The populatio 
sisted of individuals who were makin 
structive social and vocational adjustments, 
who had been under discerning supervision of 
experienced psychiatric nurses and other staff 
personnel, and for each of whom anecdotal 
records with expressions of behavioral and per- 
sonality characteristics had been made inde- 
pendently by eight of these personnel. 

The program in the Veterans Administra- 
tion Hospital at American Lake, Washington, 
carries on an intensive Practicum for student 
nurses, admitting a class of from 16 to 24 stu- 


a three-month period. 
Within the first day or two, the MMPI is 


n con- 
g con- 


re separated into small 
o four supervisors in To- 


1¥From the Veterans 

Merican Lake, W. 
facher, Chief Clinical Ps 
uable sı 
and Prof, Allen L, Edwards, 
ingtcn, gave essential ad 
tistical Problems, 


. tu 
. nae nprompt 
tation. These supervisors record imp 


= days, if 
impressions of each student every 7 a ads 
addition to using a rating scale. A z4 S 
ditional staff personnel, under w nienti 
student is observed in special es =n 
record comments. These various notes 4 
to central files. 


Procedure 


Copious notes and MMPI a ae 
were available for study on 97 fo oe 
dents. The MMPI scores hed tu 
using K (and omitting Mf). „istics men 
out to be 92 personality vee escri P 
tioned by at least two supervisors ka while 
ing students. One-half represented ae approx 
the other half represented a cece 
mately opposite to the assets. puted P 
correlation coefficients (tr) were com 


nel 
reque 
tween scores on MMPI scales and f 


wer sheets 
j stu 


puted, 
rne 


su” 

ee, , tioned MT ui 

of characteristics or traits as oe the disti 
pervisors. For one scale at a ti res WaS | 


bution of subjects in terms on percen a 
vided dichotomously at the id not be ma of 
Whenever a dividing point cou sul 


ew S 
close to this percentile because ees regio 
jects having the same score in ccordi 
these few cases were separated a tha 
the relationship of subject’s score ei es. ag 
to her own mean score for all the nse ae 
instance, if three subjects had e or the of 
cutting the distribution to one si 


d unde 
of the 75th percentile on a scale needed 


: s was 
sideration, and one of the cases by 


tion 
n men 
? Whenever a given asset had been pposite by 


. f 
one supervisor and its approximet _ This ar pa 
other supervisor, neither was ently the itemi, dy 
infrequently. Far more freque a supervi s stl! 
been mentioned by at least ae tig in tb 
fact over 40% of all the eame m on 
were supported by the same e€: east 
individuals being made by at 
supervisors, 
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ihe teeny group to round it out closer 
with the e of the distribution, the subject 
included = “se general profile level would be 
relatively hi = a on that scale would be 
subjects in Sher than those of the other two 
Sr terms of their over-all profiles.) 
WaS cora ae r, the top 25%, or high score, 
tsiBation for with the remainder of the dis- 
curred, The Proportions in which a trait oc- 
Score, this Same procedure was used for low 
the dividin me using the 25th percentile as 
the ends o Di Divisions were made near 
Centers, beca distributions rather than at the 
extreme ome of interest in what the more 
an interest ag might represent, analogous to 
deficiency, n superior intellect or in mental 
0 : 

ators on ene were made for high and low 
cach of the Pes of the clinical scales, with 
and mean a ma High and low L, EB, 
SEE too: fei p ere also included. There 
SPread in jee scores above zero, and the 
these ; Scores was too narrow to include 
1n both Sen comparisons. For each scale and 
Correlated <a the traits were listed which 
confidence oo. it at or above the .05 level of 
‘his leve ra t ns which failed to reach 
"ation, In re dropped from further consid- 
Were addition to traits, the MMPI scales 


compa 5 
SUpery; Pared with elements evaluated by the 


Sı 

Gan the formal rating scale. 

Eroup o cedures were repeated on a new 

student nurses. Only correlations 

eristicş E scale scores and personality 

r both ta which reached the .05 level or 

“I8ificant mes were considered as sufficient- 
or reporting here. The new 


co: : 

In Ntain, 

“oOmputat; ed too few low K scores for use 
‘tations. 


Results 


Fo 
the the 92 aas 
aS Was a traits considered in this study, 


ätionshjp Possibility of 1932 coefficients of 
the | of which 115 turned out to have 
ea e ae of significance or higher, 
oie &roup <r group of 97 students and 
tion, LDS in k 40 students. Below are listed 
of: e the positive and negative direc- 
traits. various MMPI scales, and the 
T accordi; traits are listed in descend- 
st ( 2 ng to size of tr. The chi- 
was applied, and those items 
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which reached the .05 level or better for both 
the original and new samples are italicized. 
(Some findings not supported by g? nor listed 
are discussed in footnote 3.) An asterisk (*) 
denotes that the relationship is supported by a 
significant one, at the .05 I-vel, in the opposite 
direction for the group scoring opposite on the 
same scale. All remaining items in the list are 
similarly supported but not significantly so. 
When a trait in the list is followed by “— 
minus,” a negative r is denoted. However, 
when significantly positive and negative rela- 
tionships obtained for traits with the two ex- 
tremes of scales respectively, only the positive 
ones are listed, the negative ones being implied 
by the asterisks. 


High L score: *Afraid of mental patients, *Has 
difficulty expressing self orally, Persevering, Pas- 
sive, *Feels insecure about self 

Low L: *Poised and at ease around others, Not in- 
dustrious, Friendly 

High K: Reserved, Mature, Afraid of mental pa- 


tients, Has difficulty expressing self orally, 


Friendly S 
Low K: (Too few cases in the new group for sta- 


tistical treatment) , 
High Hs: *Adjusts slowly, Alertness—minus, Ease 


of oral expression—minus 
(None other than opposite of first item for 


Low Hs: 
High Hs) , 

High D: *Shy, *Nonaggressive 

Low D: "Initiative, *Poised and at ease around 
others, Participates actively in group discussions, 


*Adjusts rapidly, *Good socializer, *Emotionally 
stable, Efficient, *Ease of oral expression, Desires 
responsibilities 


High Hy: Immature, 
less in personal appearance, 


*Friendly, Enthusiastic, Care- 
*Cooperative, Cheer- 


ful g 

Low Hy: Industrious—minus, Self-confident 
High Pd: * Participates actively in group discus- 
*Ageressive, Desires responsi- 


sions, *Initiative, e s 
bilities, Not industrious, Adjusts rapidly, Self- 
confident, Shy—minus, *Unafraid of mental pa- 
tients, Works persistently with assigned patients 


minus, Enthusiastic weg 
*Suggestions accepted willingly, *Perse- 


Low Pd: 5 ¢ l 
wering, Stimulating personality—minus 
High Pa: *Lacks self-confidence, Dependent and 


ive, Outgoing—minus 

Low Pa: Adjusts rapidly, Dependable—minus, 
*Poised and at ease around others 

High Pt: *Participates little in group discussions, 
Poor socializer, Shy, Ingenious—minus, Neat in 
personal appearance . ; 

Low Pt: (None other than opposite of first item 
for High Pt) i i 

High Se: Participates ac 


submiss 


tively in group d’scussions, 
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Ingenious, Initiative, Poor judgment, Not en- 
thusiastic 
Low Sc: Friendly, Alert 


High Ma: *Ease of oral expression, “Initiative, 
*Ingenious, Self-confident, Efficient, Conscientious 
—minus, Reserve’ —minus, Responsible, Effective 
with mental paticats, Shy—minus, Immature, 
Poised and at ease around others, Leadership 
qualities 

Low Ma: *Participates little in group discussions, 
Adjusts slowly, Persevering 


High ave: *Initiative, Ease of oral expression— 
minus 


Low ave: Reserved 

In view of the above results, the possibility 
of predicting final grades achieved in the course 
from MMPI scores was investigated. High 
and low deviation on each scale, high and low 
mean score, wide and narrow spread between 
scale scores were tried, but significant relation- 
ships were not found. The lack of significant 
relationships might be due to the students hav- 
ing already been screened for motivation and 
aptitudes connected with nursing and there- 
fore not representing an unselected sample. It 
is also possible that some of these persons may 
have adequate counterbalancing assets that en- 
able them to function effectively in spite of 
certain personality weaknesses, and such assets 
may or may not be reflected in the MMPI 
profiles. The lack of success for prediction of 
grades from profiles was about the same as 
Weisgerber’s [3]. Also, in agreement with 
his study, there was little success in discover- 
ing the students who needed special counseling. 
A special scale for predicting grades was con- 
structed, based on item analyses of 4 versus D 
students. But when the scale was applied to the 
new group of 40 students, prediction turned 
out to be little better than chance. 


Discussion 
The primary objective of the study was to 
ascertain what kinds of personality character- 
istics might be related to high and low scores 
on the various scales of the MMPI, for a 
group of normal individuals. The more sig- 
nificant relationships are listed above. Spon- 


to tr technique) eyed up as associated (according 
Pr é ue) with deviation i irec- 
don’ Galy “for a scores in one direc. 


I. Birnet Hovey 


taneous notes made by the supervisor-observes 
were more discriminating than formal ie 
made on a rating scale, the spontancous z a 
terizations correlating more significantly y rs 
MMPI scores. In fact, no significant is 
emerged for relationships between ae it 
and the formal ratings. This may be ies 
the formal ratings’ containing more ae 
hensive judgments, or possibly because chaps 
were not on-the-spot observations, oT pe ii 
because they were used for purposes of mae” 
tion. Our findings here correspond also 
Weisgerber’s [3]. 

The list of characterizations not on Is 
differences within one group of individua A 3 
has also shown itself to have Leonel 
when applied to a new and similar ale use 
far, the list for predictions has not sa beet 
in individual cases, but such a study ee 
initiated. For groups at least, MMI ae r- 
can be used to predict personality C% 


Ly reveals 


r t 
. cant; 
$ . signif 
list. For instance high Pa correlated 


a h, 
with “persevering” but there was also oa, apriend 
tive correlation of this trait with low sith low Í 
ly” and “ingenious” were associated Yth a lac ah 
yet high Hs was not at all associated related we 
these traits. High D was negatively COFT’ og re 
“friendly” which means that supervise ate se tbe 
tively few of the individuals with “i yet at ‘iy 
on this scale as being especially frien : ontain ta 
same time the high D groups did eects noted 
more than chance ee gE sup) i 
being on the unfriendly side. e a scale „eost 
According to tr coefficients obtained, j anit 
vation might mean either strength oT igh SE i 
weakness of the same characteristie. i ivel ie 
related positively with “participa ticipate cor” 
group discussions” and also with P'e was 2° of 
in group discussions.” When high, dividua”? |. if 
panied by high Pd and Ma, the inet" y 
cerned tended to participate saber pr 10° 
neither Pd nor Ma were high, {ney eld for 
to participate. These relationships versus 
files dominated by the three scales, V4 points 
with both Pd and Ma being severa 
Sc. The tally was 11 to 1, and 2 to 'ctively- pí 
to “little,” for the two groups A s wh? 
when high Sc profiles for 18 indivi éi Me 
ticipated actively were compare pafe wert p be 
not, the medians for the latter p four 
points below the former on Pd ani 
low it on Ma. Individuals with Kiza A 
may be considered as having S draw from © oP 
they may be inclined either to vs the grou anie 
participation, or else be dominant ore aC n 
student who obtained a high Sc Sehat ct Fote 0 
by elevated Pd and Ma scores nile was Pd f 
“participating actively,” and other in class 
be very aggressively outspoken 
change the topic. 
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may be ie aaa a ward Sr Caution 
chavgctaristies fo iona one try ta predict those 
kinds of me aga eee study HOF other 
coeficients a or instance, in spite of our 
sarpe: te fae vp significance in both our 
nurses wii ' mg at apply only to student 
status in oe Z age advanced training 
observed by — Northwest, and who are 
have been pa on particular supervisors who 
The fei oe apei in our study. | 
Correlated wae that some of the traits are 
n such insta MES than one scale deviation. 
More of fie et the occurrence of two or 
should ees nee deviations in a sample 
Pearing jn ew the proportion of the trait ap- 
Cases of the iat sample. There were too few 
Prehensive ea kinds of profiles for com- 
tends to he: atistical analys s, but one sample 
With the pii = out. There were 26 profiles 
1a, whi oa highest scores being on Pd and 
Ominated a the largest number of profiles 
Wo scales y any two particular scales. These 
tively in ane correlated with “participates ac- 
ividuals prob discussions.” The group of in- 
almost half oducing those 26 profiles contained 
Sons with pa A as high a proportion of per- 
minated be — io as did two groups 
Sther hand r a and Ma separately. On the 
With one «. if a trait is correlated positively 
another scale deviation and negatively with 
Should te Concurrence of the two deviations 
Cerned, on to cancel so far as that trait is con- 
Sions” ha articipates little in group discus- 
Were 16 Ppens to correlate with high Pt. There 
thi Scal Profiles dominated by elevations on 
ale together with Pd or Ma but not 
a Lia producing these profiles con- 
ore of the trait within it than 
expectancy, 


eviati 
§ 1 i a8 
Scales „ONS on every one of the individual 


S We 
er sprains: À 
tionshi. S More loaded with significant rela- 


Ips t P 
hi Profi han in mean score or general level 


le V 
Vand > Only three traits correlated with 
rel. exe Ow mean score, whereas the various 
Clati,, Pting Hs carried from 5 to 16 trait 


Ns 
to hipp UPS: Also, none of the items related 


i 
2 ar E 

4 While a low mean score is supported by 
Ore very one of the scales carries one OF 
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to predict grades better than chance. In this 
study, shape of profile was more fruitful than 
its general elevation. 

Asset traits as well as liabilities may be as- 
sociated with elevations on MMPI scales, and 
negatively -alued traits maz" be associated with 
subaverage scores on the scales. From one to 
seven positive traits were associated with 
elevated scores on seven of the ten scales. One 
positive trait was even associated with a high 
over-all mean score. Conversely, from one to 
five negative traits were associated with low 
scores on all scales but Hs, Pt, and Se, and also 
a negative trait was related to low mean score. 
When only those items supported by x° are 
considered, the elevated scores are related to 
“desirable” and eight “undesirable” 
traits. By the same criterion, the low scale 
scores are related to thirteen positive traits 
and six negative ones. Elevated scores in clini- 
cal practice tend to signify various kinds of 
maladjustment or potentials for it, and in view 
of this, it may be inferred from our results 
that there are some personality assets associat- 
ed more with maladjustment potentials as 
measured by the MMPI than with relative 
freedom from such potentials. 


twelve 


Summary 


f 97 student nurses in practicum 
been given the MMPI, and dur- 
ing the training period the supervisors made 
notes relating to personality characteristics for 
each student. Tetrachoric r and also y? were 
applied to ascertain any relations between high 
also low scores, on the various 
MMPI scales and observed personality char- 
acteristics. The procedure was then applied to 
a new group of 40 student nurses. Traits are 
listed which correlated most significantly with 
he scales for both groups of 


A group 0 
training had 


scores, and 


one or more of t 


students. 
Impromptu notes made by supervisors 


showed more significant relationships with 
MMPI scale scores than did ratings made on 
the rating scales. Clinical observations to the 
effect that for interpretation, deviations on 
individual scales must be considered along 
with deviations on other scales, are supported 
by the data. Individual scores on most scales 
howed up as more meaningful than general 


show j 
Some traits of positive 


elevation of profile. 
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value as well as ones of negative value were 
found to be associated with elevations of vari- 
ous scales, and some negative traits were re- 
lated to low scale scores. In other words, po- 
tential for emotional maladjustment may carry 
along with it or eni.ance some positive person- 
ality characteristics. 


Received September 22, 1952. 
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A Comparison of The WISC and Stantord-Binet 
1Q’s of Normal Children 


Glen A. Holland’ 


University of California, Los Angeles 


ns ea literature has begun to 
Bence Scale op em the Wechsler Intelli- 
Scale With the S hildren. Comparison of this 
Sade: F tanford-Binet is inevitable. 

his is that the Stanford-Binet 


ìn its origi 
ori : f 
tuted ginal and revised forms has consti- 


Or 36 
Variety 
testers 


ne re 


operational meanings for its 
and beyond those given by its 
on procedure. An obvious econo- 
e Ta S if the correlation of 
to warrant inet with a new scale appears 
Wii eee aa degree of generalization from 
umulated experience. 


reported, June, 1952, six studies have been 
the WrgeomParing the Stanford-Binet with 
two of C Sing normal subjects [1, 2, 5, 11], 
theses a these being unpublished Master’s 
bese ere by Pastovic and Guthrie [5] 
cen one : M the writer. Three studies have 
from, es Using defective subjects ranging 
“telligen moron through borderline grades of 
ad cone, [4, 8, 9]. The procedures, data, 
potheses, Usions reported suggest certain hy- 
red state ese will be given below in num- 

ments along with relevant evidence. 


h 
fe prone of testing (S-B first or WISC 
Mence jn ape 2 Statistically significant dif- 
Is G Altho mean IQ’s obtained with the 
Sty “been a T his specific hypothesis has 
les in wo UE AS: implied in at least four 
U ave wa the investigators report that 
»2, 5, 8]. ternated the order of testing 


Tite y 
llow; E to express his appreciation to 
e oak, ne who did testing for this study: 
oe Hara Bae Lawton, Patricia Marshall, 
ordon g, dward Ormsby, Virginia Sand- 
outhon, and W. G. Willis. 


TR, 


2. The correlations with Stanford-Binet 
IQ's will be significantly greater for WISC 
Full Scale and WISC Verbal Scale than for 
WISC Performance Scale 1Q’s. Relatively 
clear-cut results to this effect are given by 
three studies [1, 8, 11]. Two others have not 
reported relevant data [4, 9]. Pastovic and 
Guthrie [5] cite one study in which this hy- 
pothesis receives support and three others in 
which the results are ambiguous. Krugman, 
Justman, and Wrightstone [2] found that for 
their total group of 332 subjects the corre- 
lations with Stanford-Binet 1Q’s for the Full 
Scale and Verbal Scale were higher than for 
the Performance Scale. However, at some age 
levels there was little difference between the 
correlations for Verbal Scale and Performance 
Scale with S-B IQ, and in a few instances 
the Performance Scale correlation was 


greater. 

3. The cor 
TQ’s will not 
WISC Full Sca 


relation with Stanford-Binet 
be significantly different for 
le and WISC Verbal Scale 


1Q’s. Two studies report practically identical 
correlations between these two WISC scales 
and the Stanford-Binet [8, 9].Weider, Noller, 
and Schramm [11] found identical correla- 
tions for their subjects as a whole, but when 
the group was divided with respect to age a 
difference appeared for the younger group 

r= .82 for the Verbal Scale, r=.90 for 
the Full Scale). Pastovic and Guthrie [5] 
indicate approximately equal correlations with 
the Stanford-Binet for the two Scales in one 
study which they report but find differences 
of from 06 to .08 in three others. The dif- 
erence between the correlations is .09 in the 
data of Frandsen and Higginson [1] and 18 
for the total group of subjects studied by 
Krugman, Justman, and Wrightstone [2] 

4, There is a significant relatiunshin be- 


147 


148 


the subjects tested and dif- 
ee Sante and WISC IQ's. 
A Justman, and tie [2] 
found a significant relationship between c yon 
ological age and differences between S-B an 
WISC 1Q’s for both the Verbal Scale and 
the Full Scale. A chi-square analysis indicated 
that the differences were greater for their 
younger subjects, with the WISC IQ's being 
lower. Pastovic and Guthrie state, “We con- 
clude that the WISC should not be interpre- 
ted as equivalent to a Binet IQ at age levels 
below 10 years since the WISC score is con- 
sistently lower than that of the Binet” [5, 
p. 385]. Still more evidence comes from the 
work of Weider, Noller, and Schramm [11], 
who found significant differences in mean IQ 
between the Stanford-Binet and the WISC 
for subjects up to 7 years, 11 months old, but 
relatively small differences for older subjects. 
Frandsen and Higginson [1] report differ- 
ences which are statistically significant for 
their group of fourth-graders ranging in 
chronological age from 9 years, 1 month to 
10 years, 3 months. The three studies of de- 
fective subjects with mean chronological ages 
of 11 years, 11 months or older [4, 8, 9] have 
agreed in finding relatively small differences 
between mean S-B and WISC 1Q’s with the 
WISC IQ's being consistently higher. Nale 
[4] reports, however, that the difference of 
2.59 IQ points which he found is significant 
at the .01 level of confidence. 

5. There is a significant relationship be- 
tween the size of Stanford-Binet IQ’s and 
the difference between Stanford-Binet and 
WISC IQ's. Such a relationship is reported 
by Krugman, Justman, and Wrightstone [2], 
who correlated S-B IQ's with the differences 
between S-B and WISC IQ's for all three 
of the WISC Scales. The three product- 


Moment correlations obtained were all signifi- 
cantly greater than zero. 

Ithough not Pertine 
Stanford-Binet and 


tional hypotheses of some 
gested by 


: the studies done t 
- There is a Significant difference between 


a ae Verbal Scale and Performance 
oe oe s. This is the contention of Pastovic 
n uthrie who state >“... our data and 

Ose of three other studies cited, find a 


nt to the comparison of 
WISC 1Q’s, two addi- 


interest are sug- 
o date. 
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higher mean performance IQ than vital TS 
over a wide range of intelligence, A 
the WISC was intended to have a di a (5, 
of zero points between these i basis 
p. 385]. Seashore [7], however, m 
of the test data for the entire W la E be- 
ardization sample, found zero aero Per 
tween the mean IQ's of the Verbal anc 
formance Scales. betwee! 
7. There is a significant correlation ka ae 
WISC Full Scale [Q's and the differen nance 
tween WISC Verbal Scale and pee k, 
Scale IQ's. The evidence on this porne afoativé 
being based on the observation at ‘that for 
subjects only. Seashore [7] ETIC stand- 
55 feebleminded subjects in the ‘egiserepaney 


ardization sample the mean formance 


score” (Verbal Scale IQ minus BT in 
Scale IQ) was a —2 points. A acm ale 
mean IQ of 4.9 points ee? an 
mean IQ greater) was found at né diret 
Schneider [8]. A difference in the creel and 
tion of 5 IQ points is reported by 9S ari 


ri 
atter: compa 
Levin [9]. For both of these latter tistical) 


: . is sta 

sons the difference in means a confident? 
significant at the .001 level eit subject 
(computed by this writer). Whe Terb? 


of superior intelligence have high has not 
Scale than Performance Scale om sec” 
yet been reported, but the possto!''™ 
worth investigating. 


Procedure and Subjects oot 


was “tu 
The testing for the present "n pa T 
by a small group of senior eae a p 
dents of the University of Cali p 


ted P, 
A comple 0 
Angeles. These students had comP cor 


pleting concurrently at least a 
intelligence testing, including 
intelligence test practice under oe 
of the writer. o ex 


instructed t° © 
These students were instruct with "pe 


at least ten subjects of varying = Ea 
the Stanford-Binet Intelligence k C 
Wechsler Intelligence Scale 1° 
Half of their subjects were 
Stanford-Binet first and half mi : 
The test booklets were then ¢ evidence K 
writer for scoring errors and he test 
errors in administration. From “reenit” 
lets which remained after this $ 


WISC and Stanford-Binet 1Q’s of Normal Children 


were chosen representing subjects who were 
i the WISC first. The ages of the sub- 
A E from 5 through 13 years with 
of 2.5 i .3 years and a standard deviation 
girls, ne Seventeen were boys and 9 were 
group = The Stanford-Binet IQ for this 

Pi baci 3.7 (SD 15.8). An additional 
ae ooklets were then chosen representing 
igh five had received the Stanford-Binet 
as to repro a being made in such a way 
cal ERS Ea far as possible the statisti- 
above, Fo = See of the group mentioned 
ological the second group the mean chron- 
5 Veuve S was also 9.3 years and the SD 
and 12 way Saron of this group were boys 

te ere The mean Stanford-Binet 
groups ea 7 (SD 15.5). After the equated 
remained E made up, an additional 20 records 
tested with py ey subjects who had been 
to those m the S-B first. These were added 
the chi-g entioned above for the purposes of 

Square analyses to be reported. 
Was 8 longest interval between the two tests 
ays (1 subject), and the shortest 
Jects tt, days (2 subjects). Most sub- 
- meq ut en the two tests a week apart, 
ne TS 4 interval for the entire group be- 
tested Fe Forty-one of the subjects were 
Were test, L of the Stanford-Binet and 
ed with Form M. 


sub 


nterya] 


Results 


ily 
10's, i effect of order of testing on WISC 
first the T the group examined with the WISC 
the Ver Mean IQ’s obtained were 110.4 for 
Scale, a a Scale, 110.8 for the Performance 
frou 111.4 for the Full Scale. For the 
the ee with the Stanford-Binet first 
ity. “esponding mean IQ’s were 111.3, 
differ and 112.5. "The £ values [6] for the 


Nees 
Vert between means were .22 for the 


al 
ga 27 cale, .13 for the Performance Scale, 
ences ee the Full Scale. None of the dif- 
and Te statistically significant. 
a Wisi Ti correlation of Stanford-Binet 
ated ox Q's. For the 52 subjects in the 
ig of the a the product-moment correla- 
ps : Stanford-Binet with WISC IQ’s 


S aa the Verbal Scale, .73 for the 
ale, eS Scale, and .87 for the Full 
€ critical ratio for the difference 
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between the first two correlations, follow- 
ing the statistical procedure suggestéd by 
McNemar [3], is 2.96, and the probability 
that the correlations are equal is less than 
002. The critical ratio for the differences 
between the second and third correlations is 
4.55, indicating a probability of less than .001 
that the correlations are equal. However, 
when the correlations of the Stanford-Binet 
with the Verbal Scale and with the Full Scale 
are compared, the critical ratio for the differ- 
ence in correlations is only .36. It is obvious 
that for this comparison the null hypothesis 
cannot be rejected with any appreciable de- 
gree of confidence. 

4. Age and differences between Stanford- 
Binet and IVISC IQ’s. The statistical analy- 
sis of the relation between age and differences 
between Stanford-Binet and WISC IQ's 1s 
based on the records of 72 subjects. A2X2 
table was set up dividing subjects with respect 
to age at the 10-year level and with respect 
to differences between Stanford-Binet and 
WISC IQ's into those for which the differ- 
ence was 5 points or less and those for which 
the difference was 6 points or greater. The 
value of chi square for differences between 
Stanford-Binet and Verbal Scale IQ’s was 
1.006, which has a probability greater than 
30 of occurring in samples in which there is 
no relationship between the variables com- 
pared. The value of chi square for Stanford- 
Binet and Performance Scale IQ differences 
was .082, p greater than .70. The value of 
chi square for differences between Stanford- 
Binet and Full Scale IQ’s was 1.47, p greater 
None of the chi-square values 
warrants the rejection of the null hypothesis 
of no relationship between chronological age 
and differences in Stanford-Binet and WISC 
IQ’s. 

To provide d 
other studies, 


than .20. 


ata comparable with those of 
mean IQ’s were computed 

arately for subjects 10 years and older and 
ete less than 10 years old. The mean 
Stanford-Binet IQ for 23 subjects 10 years 
or older was 115.3. The mean WISC IQ's 
were 113.2 for the Verbal Scale, 112.9 for 
the Performance Scale, and 113.6 for the 
Full Scale. T he z test [6] indicates that none 
of the mean WISC IQ’s can be considered 
significantly different from the mean Stanford- 


150 


i r these subjects, the ¢ values being 

SS Verbal Scale, 1.00 for the Per- 
formance Scale, and 1.00 for the Full Scale. 
The mean Stanford-Binet IQ for the 29 
subjects in this study who were less than 10 
years old was 112.3. The mean WISC IQ’s 
were 109.1 for the Verbal Scale, 109.6 for 
the Performance Scale, and 110.6 for the Full 
Scale. The corresponding ¢ values for differ- 
ences between mean Stanford-Binet and mean 
WISC IQ's are 2.26 for the Verbal Scale, 
1.37 for the Performance Scale, and 1.41 for 
the Full Scale. Of these £ values, only the 
first approaches Statistical significance, the 
probability being .012 of obtaining a differ- 
ence as large as that observed when there is 
no real difference in the means compared. 


5. Stanford-Binet IQ’s and differences be- 
tween Stanford-Binet and WISC IQ’s. The 
records of 72 subjects were used for the chi- 
square analysis of the relationship between 
Stanford-Binet IQ’s and the difference in 
Stanford-Binet and WISC IQ's. Subjects 
were divided into those with Stanford-Binet 
IQ’s of 114 or greater and those with Stan- 
ford-Binet IQ’s of less than 114. Each group 
was then divided into those with Stanford- 
Binet and WISC IQ differences of 
or more and those 
points or less. Th 
Verbal Scale IQ 
with a p greater 
hypothesis, Chi 
Scale IQ’s were 
greater than .30, 
IQ's were inyoly 
than .50, None 
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than 3.75, either plus or minus. ETE: 

When the differences between Ver f hout 
Performance Scale IQ's are taken x Krs 
regard to algebraic sign the data : He 
present sample indicate a crude mode for 
distribution of 4.5 points difference oe oÍ 
with 27% of all differences being either "al 
5 points. The median absolute ‘lage ane 
6.8 points and the mean absolute ana 
8.4 points. Q, for the distribution of abs 
differences was 4.43, and Qs was a ioe 

7. WISC Full Scale 1Q’s and the AN" 
ence between Verbal and HEEL ORIANSE a 
IQ's. For 52 subjects the discrepancy * cale 
(Verbal Scale IQ minus Performance a 
IQ) suggested by Seashore [6] wei Scale 
puted and correlated with WISC Ey n wa 
IQ’s. The product-moment correlatio corre 
-14 with a standard error of .14. Such ficant 
lation cannot be considered as signin 
different from zero. 


Discussion 


n 

The present study fails to suppor" 
of the trends noted in earlier studies have 
WISC. Although several ar sc 
alternated the order of testing with t ea aso” 
and Stanford-Binet (and there is as matte 
for failing to do so in the future as indicat 
of precaution), the present u 
that the order of testing does not pa o 
nificant effect on mean IQ for a y at 
WISC Scales, The data of this et = 
with those of the majority of prev Binet don 
gations in finding that the Stanfor forms al 
not correlate as highly with the h the vert 
Scale of the WISC as it does waite te n0 s 
and Full Scales. They also ae oF g 
nificant difference in the correla cale E 
Stanford-Binet with the Verba wI 
with the Full Scale IQ's of the 
though previous information on a 
varied among different sce ange at least wo! 

Contrary to the conclusions © resent * 
other investigations [2, 5] the Pi a rela thé 
fails to find clear-cut evidence ri ari 
ship between the age of abia A 1sC en 
difference in Stanford-Binet al te diet ios” 
A chi-square analysis of atso aa 
and age failed to show a sign" ign fo 
ship. Nor was it possible to fin a sta? 
relationship between the size 


nany 
e 


ve 4 


- 


a 


WISC and Stanford-Binet 


Binn IQ's and the amount of difference be- 
veen Stanford-Binet and WISC IQ's. 


The present study agrees with Seashore’s 
*apart on the standardization sample of 
erfor Ţ wterence between Verbal and 
this differen Scale IQ's and suggests that 
Stites "nag cannot in all probability be 
Tepresented iH a IQ points in the universe 
tive EE a ps sample studied. The tenta- 
ship between W there might be a relation- 
erences aed ISC Full Scale IQ and dif- 

veen Verbal and Performance 


cale IQ for 
tiated Q for normal subjects was not substan- 


the “yonsidering the results of the studies of 
arth some os date, the writer wishes to put 
that the Ge entative suggestions. The first 1s 
“fectives Se of the WISC with high-grade 
relatively oon to give results which are 
Is j UStrated be to the defective group. (1 his 
this area a y the fact that for all reports in 
Consistent hi mean Performance Scale IQ is 
l ) Th Y greater than mean Verbal Scale 
Wisc sie is that generalizations about 
ased upon the study of a relatively 


Zero 


thos Present study appear to differ from 
Jects e two studies employing normal sub- 
Study „p Vatious ages [2, 11]. So far as the 
rie er cider, Noller, and Schramm [11] 
tent gp ed, the present data agree on the ex- 
ri WI Correlation between Stanford-Binet 
to relati IQ’s but differ with respect to 
$ on of chronological age to differences 


e 
The S2 Stanford-Binet and WISC. IQ’s. 
Hi ee used in the earlier study were 
wh ha lead than those in this study 
G wer mean IQ’s. However, even 
Subjects less than 8 years old from 
study are considered (to form a 
evi Dle to the “younger” group in 
iffere Study), there is still no signifi- 
i sce between Stanford-Binet and 
n gni Coe Neither was it possible to find 

enta] tionship between Stanford- 
| Ages and Stanford-Binet— 
i S iferences, The only remaining 
ence in the nature of the two 


n only 
Tesent 
Com 
rey; p 
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studies lies in the fact that the Stariford- 
Binet and WISC were usually given either in 
two sessions on the same day or in a single 
session in the Weider, Noller, and Schramm 
study. This suggests the possibility of constant 
errors of measurement (particularly with 
younger subjects) based on fatigue, loss of 
interest, and similar progressive changes in 
the subject. There is no indication in the re- 
port that the order of testing was varied, 
which might become an important considera- 
tion when the interval between tests is quite 
short. 

Even this possibility does not exist to ac- 
count for the differences in results between 
the present study and that of Krugman, Just- 
man, and Wrightstone [2]. Their work was 
much the more extensive, including a total of 
332 subjects well distributed throughout the 
age range to which the WISC is applicable. It 
must be considered the definitive study of 
Stanford-Binet—WISC comparisons to date. 
Nevertheless, the fact that the present study 
failed to find a significant relationship between 
either chronological age or Stanford-Binet IQ 
and the difference between S-B and WISC 
IQ’s may serve to stimulate further research 
and to suggest caution in making generaliza- 
tions. 

Since the fact that student examiners gave 
the scales in the present study might suggest 
that this was a factor in the results obtained, 
the writer has compared the results of their 
testing with that of the standardization test- 
ing on two points where comparable data are 
available. As noted above, Seashore [7] found 
a mean difference of zero between Verbal and 
Performance Scale IQ’s and a standard de- 
the differences of 12.5 points. He 
reports a median of 8 points for the absolute 
differences. The data of this study show a 
mean difference of zero points with a stand- 
ard deviation for the differences of 10.2 points 
and a median of 6.8 points for the absolute 
differences. For his subjects 10% years old 
Wechsler [10] reports correlations of 68 
between Verbal and Performance Scale IQ’s, 
93 between Verbal and Full Scales, and .90 
between Performance and Full Scales. For 
the present study (in which the mean age was 
9.3 years) the corresponding correlations are 


.75, .94, and 92. 


viation for 
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Summary 


Seventy-two subjects were given both the 
Wechsler Intelligence Scale for Children and 
the Stanford-Binet Revised Intelligence Scale. 
Twenty-six subjects were examined with the 
WISC first and could be equated, as a group, 
with 26 subjects examined with the Stanford- 
Binet first. A statistical analysis of the results 
indicated: 


1. No significant practice effect on WISC 
IQ’s when the Stanford-Binet was given first 
and the median interval between tests was 
7 days, 

2. Significant differences between the corre- 
lation of Stanford-Binet with Performance 
Scale IQ’s and the correlations of Stanford- 
Binet with either Verbal or Full Scale IQ’s 
on the WISC. 

3. No significance for the difference be- 
tween the correlation of the Stanford-Binet 
with Verbal Scale and its correlation with 
Full Scale IQ’s on the WISC. 

4. No significant relationship between 
chronological age and the differences between 
Stanford-Binet and WISC IQ's for any of 
the WISC Scales. 

5. No significant relationship between 
Stanford-Binet IQ and the differences be- 
tween Stanford-Binet and WISC IQ's for 
any of the WISC Scales, * 

6. Zero mean difference between WISC 
Verbal Scale and Performance Scale IQ’s with 
a standard error of the mean of 1.42 points, 

7. No significant relationship between 
WISC Full Scale IQ's and the difference be- 


tween WISC Verbal Scale and Performance 
Scale IQ's. 
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Note on Elwood’s Study of IQ Changes 
Quinn McNemar 


Stanford University 


mg cent paper by Elwood [1] purports 
rested Anine the validity” of corrections, sug- 
to 1Q' y ie present writer [2, pp- 172-174], 
diferen or differences in IQ variability at 
correctio age levels. She reasons that since 
ower tons at age 6 tend to make low IQ’s 
Corre hs would expect those with low (un- 
at age g ) 1Q's at age 6 to have lower values 
er è where no corrections are needed. 

Tetest ae Involves a comparison of test- 
and rete S of three groups of children tested 
8roups ah at about ages 6 and 8, the three 
ISt tes ving been selected on the basis of the 
50. St as those falling in the three intervals 
Then’ 60-69, and 70-79 on the IQ scale. 


en F 
Top “ag the basis of averages, the “expected” 
Occur S at the second testing did not 


mende hence it is implied that the recom- 
Corrections are not sound. 

that at Elwood failed to consider is the fact 
Tegression upward has neatly counter- 


balanced the “expected” drop in IQ. Indeed, 
the lower variability at age 6, compared to 
that at age 8, is responsible for the failure of 
these cases, so chosen, to show a regressive 
gain. If Elwood wishes to make an unambig- 
uous factual contribution to this problem by 
the longitudinal approach, she should simply 
compare the SD for all cases tested at circa 
age 6 with the SD for the same cases retested 
two years later. It must, of course, be pre- 
sumed that the cases are unselected, i.e., typi- 
cal of 6-year-olds. 
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i Books 


Bowers, Henry. Research in the training of teach- 
ers. Toronto: J. M. Dent & Sons (Canada) Ltd., 
& Macmillan Co. of Canada, 1952. Pp. vii + 
167. $1.90. 


The book consists of a series of fourteen papers 
dealing with some of the many factors that influ- 
ence a student's success in practice teaching. Each 
Paper is a separate unit dealing with one phase of 
the problem. They are carefully organized, stating 
clearly the question, the methods used, the results, 
and the conclusions obtained from the study. The 
concluding summary analyzes the student’s back- 
ground, personality traits, interests and activities, 
social acceptance, capacity for leadership and other 
factors, in relation to their effect on the student’s 
Success in practice teaching. The book should be of 
special interest to those who are training our fu- 
ture teachers, and to high-school counselors who are 
advising students in regard to their possible success 
as teachers. One wishes that the study were based 
on success in teaching after several years of work, 
rather than on the more academic situations found 
in practice teaching —B. M. L. 


Davidson, Henry A. Forensic psychiatry. New 
York: Ronald Press, 1952, Pp. viii + 398. $8.00, 


This book is designed as a psychiatric-legal guide 
for physicians, particularly psychiatrists, who may 
be called upon as expert witnesses. It begins with a 
careful discussion of the McNaghten formula, the 
basis for the determination of criminal responsi- 
bility in this country. It includes description of 
types of examination and reports, and discussion of 
the Physician’s role in cases involving personal in- 
Jury, annulment of a marriage, custody of children, 
evaluation of testamentary capacity, appraisal of 
sex offenders, alcoholics, juvenile offenders and 
malingerers, and a description of commitment pro- 
cedures and the competency of the mentally ill, The 
Situations chosen to illustrate the discussion of mal- 
Practice as it applies to the psychiatrist will be of 
Interest to psychologists, particularly one in which 
a psychologist was the chief target of criticism. The 


book also includes a discussion of courtroom prac- 
tice. — A.R. 


Note: The reviews wer x 
> e 
and the Associ prepared by the Editor 


iate Edi identi 
tee ni e Editors, who may be identified by 


ic study of 
Eissler, Ruth S. et al. The psychoanalytic ange 
the child, Vol. VII. New York: Internation? 
versities Press, 1952. Pp. 448. $7.50. 


jtute 
. Pie onstitul 
Of 21 chapters in this volume, the first 4c 


J 
a symposium on the Development ae a id 
held at the Congress of the Internationa eat j 
analytical Association at Amsterdam, ee 
1951. This symposium is highly techn eyoholds 
probably of interest only to analysts. Monnl greate 
gists will probably find the other chapters ' seth 
interest, since they are more clinically Oe al ren— 
majority of them deal with very young deal ith 
age two to four—and three sections f 
anxiety factors related to hospitalization appro? 
children. An interesting methodologica ihe use 
in the second of these three discussions 1$ 
a film for the psychoanalytic study hie 
child. One of the most valuable gicu _ Peat” 
volume is a 65-page chapter by Gerald ` in ild 
son, “A Survey of Learning Difficulties 
ren.” This is both a survey of the pe 
literature on the subject, as well as an learn g 
of the author’s thesis, “The ability to disorde" k 
function of the ego and therefore pee ego e 
produced by influences which aftect learning di es 
tions.” Seven major factors causing A cas 
culties are discussed, and abstracts j 
are used illustratively.—M. K. 


ns 0 


hoana, p 
laborat! 


Eysenck, H. J. The scientific study of nd 
London: Routledge and Kegan Bay 
York: Macmillan, 1952. Pp. x! pis 

to the ©. py” 


$ " 1 
This volume, in a sense a seque more ©; use 


senck’s original and ingenious exper 
of objective tests in the appraisa 
contrast to questionnaires and 
deserves wider attention in the UD o i 
studies lead to one main proposition y wir go 
ence of three dimensions of pete trov? th 
relatively independent: introverst rame ° ic 9, 
neuroticism, and psychoticism. ? a 
erence “, . . the question: ‘Is this P 5 
neurotic?’ becomes as unreasonable | 
‘Is this person intelligent or tall 
experiments which support these lyz 
the main, neatly designed and ana 
sharp tests of propositions 
Some of them, however, seem to 5%, grou” uly 
of cross validation on independen weve! 
statically cross-sectional approac™) 


h poti 
7 ed S the! 
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New Books and Tests 


a saan almost inevitably to a hereditarian posi- 
fe 1. Fe eter espouses “constitution” as the cause 
i in ividual differences in personality, and gener- 
E psychogenic hypotheses based on clini- 
idoalen One may hope that someday he will 
ing ie the experimental investigation of learn- 
of ee apply his considerable talents to the study 

ge as well as to the study of status. —L.F.S. 


Fi Pan j 

een Miriam F. Deaf children in a hearing 
orld. New York: Ronald Press, 1952. Pp. viii 
+ 320. $5.00. 


ene = that handicapped children should be 
al childre educated in close association with norm- 
Practiced oe widely accepted but all too rarely 
teachers his semipopular book, for parents and 
Specialist as much as for psychologists and other 
Petiment reports experiences arising from an €x- 
of-hearin in the normal education of deaf and hard- 
count a gramme The chapters contain an ac- 
and IA e experiment, case studies of children, 
Pintaa eet parents’ problems based on 

ibed recordings of discussion groups:—L.F.S. 


Gil 
T Jeanne G. Understanding old age. New 
: Ronald Press, 1952. Pp. ix + 422. $5.00. 


Teri 1s a welcome addition to the growing litera- 
Walifed ene by a pioneer, productive, well- 
compendi writer, As an organized informational 
ers in E it will be helpful both to present work- 
ersed į e field and to those who may not yet be 
any ‘a the field’s importance. It leaves unsolved 
of ues which becloud the critical evaluation 
“y y many studies here collected. Is gerontology 
Conen ee study of the phenomena of aging” 
anabolic sentence, p. 3)? Is aging a continuing 
death “catabolic reciprocation from conception to 
and fe it some later or final segment of growth 
old alite Which of its instar stages 1S really 
lifes And do we “age” at equal rates at all 
Unequal} Periods, or do our organ-systems regress 
Volutio, a during involution as they progressed in 

ividus Who is old, when, why, and by what 
Telated ih differences? Is longevity positively pr 
Young? vith favorable aptitudes, or do the good die 
Petimenta tt constitutes a standard sample he ex 
Comprise and control studies? Does “old age” 
ily ps a “clinical” syndrome? If so, is it primar 
A Ychosomatic or somatopsychic? Until such 


ISsy, 

neyed are resolyed one may still endorse the hack- 
Mine.” quip that “old age is any age older than 
: blems and 


o r. Gilbert ri izes these pro 
erg ecognize: í s 
uch material toward their solution. Adding 


o 
Our k 
z a 
derstand dee about old age increases our u 


ing of it. — E. A.D. 


Hilgar d, 


Pian-M S., & Pum- 


Ernest R, Kubie, Lawrence 9. 
ience. Stan- 


indlin, E. Psychoanalysis as s¢ 
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ford, Calif: Stanford Univer. Press, 1952. 
+ 174. $4.25. 


The title of this book is eye-catching, but its 
content turns out to be something of a disappoint- 
ment. It is a clear and able summary of much that 
has been said about psychoanalysis, but contains no 
strikingly new evidence. Of five lectures given at 
California Institute of Technology in 1950, the first 
two, by Hilgard, summarize the findings of experi- 
mental psychology which are relevant to psycho- 
analytic dynamics and therapy. Two lectures by 
Kubie describe the techniques of psychoanalysis, 
persuasive but nonexperimental illustrative 
anecdotes, and cite the main premises of psycho- 
analysis. In the final lecture, Pumpian-Mindlin 
traces the historical development of psychoanalysis 
and its relationships to the biological and social 


Pp. x 


with 


sciences.—L.F.S. 


Krieg, Wendell J. L. Functional neuroanatomy 
(2nd Ed.). Philadelphia: Blakiston, 1953. Pp. 
xviii + 659. $9.00. 


This magnificent text and book of charts de- 
serves to be brought to the attention of all psycholo- 
gists. It is outstanding in two respects. First, it is 
more genuinely functional than most books on 
neuroanatomy with clear descriptions of what the 
neural structures do. Second, many of its 274 fig- 
ures, and its 88 pages of atlas, have a remarkable 
three-dimensional quality which facilitates visualiz- 
ing the nervous system “in the round.” While most 
effectively used in connection with a laboratory 
course, the text js a suitable adjunct for any course 
in physiological psychology.—L. F. S. 


Reik, Theodor. The secret self. New York: Farrar, 
Straus, & Young, 1952. Pp. 329. $3.50. 


In his fiction-like style Reik opens with a conver- 
sation he had with Freud, and closes with satisfy- 
ing insights he experienced one dawn as he ended 
an insomnious night of personal struggle with deep 
sleep. Such is the tone of another volume devoted 
to the thesis that psychoanalysis is a great adven- 
ture in inner experience and not a routine with 
mental gadgets manipulated by skilled technicians 
of the unconscious. To be a creative experience for 
the patient it must first be such for the analyst. And 
so it is for Reik. He demonstrates this in twenty 
chapters of subjective notes linked with case ma- 
terial and classical literature. These are “impres- 
sions obtained in everyday life and in analytic 
sessions [which] awakened echoes of other inner 
experiences shaped by a great writer.” Reik adds a 
contribution indeed to our contemporary scientific 
emphasis in clinical psychology. His voice reminds 
us that the direction of human adjustment is at best 
a creative process, an aspect which needs emphasis 
in our training program. Science and this subjective 
emphasis together may teach us that the anvlyst can 
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“listen to his patient and to his own associations,” 
but this art is a highly finished one requiring much 
nurture and difficult to validate. — F. McK. 


Shaffer, G. Wilson, & Lazarus, Richard S. Funda- 
mental conceptsvin clinical psychology. New York: 
McGraw-Hill, 1952, Pp. xi + 540. $6.00. 


well beyond the narrow field of clinical psychology 
itself to supply Supplementary background material 
from all of psychology, Chapters on 
methodology and on the nature of personality illus- 


The range of human Capacities, 
Baltimore: Williams & Wilkins, 
190. $4.00. 


The changes in this revision consi 
the addition of two chapters, i 


human Capacity, and on Tange in productiy, 


indicating the following 
(ave. 1.30:1), 


A L body circumference 
), Physiologic function (2.07:1), 
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tion): © P; S, Co., 1952. 
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The ten supplementary pictures for the EAn 
designed for use with children whose SE 
problems or previous responses suggest peer 
areas of investigation, The ten situations, a the 
by human-like animals comparable to those laying 
CAT, represent peer play, schoolroom, easel 
house, mothering, injury, competition, body regnant 
visit to physician, bathroom scene, and p ethods 
mother. The manual recommends pace respons 
for using the Pictures, and describes typica ix an 
es, with limited normative data on pe be 
Seven-year-olds. These ingenious materia s raisal 
a useful tool for research and clinical apP 
—L. FS. 


chool 

Jay, Edith Sherman. A book about me. “eye 40 

gr. 1, ages 4-7. 1 form. Untimed. Book ‘ manual 

Per 10); analysis sheets (55¢ per aa on Sci 

PP. 32 (25¢); specimen set (50¢). Chica 

ence Research Associates, 1952. pey 
$ as 
A Book About Me provides material stich and 
of children’s backgrounds, maturity, acti first-grade 
interests, at the prekindergarten atti ei 
level. Children mark pictures in an attr A orni 
according to standard instructions ole E 
survey, or according to more flexible r teach a 
other uses which may be planned by t “arte bs 
investigator. The manual describes the 4 and Sv 
cedures and the auxiliary analysis yee? activ! 
Bests further uses of the material in sc 
Programs, — L, F, §, 
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Pd Process-reactive hypothesis regarding 
in t 2 ag may be stated as follows: With- 
can be Ge Shizophrenia two subgroups 
Or true 'Herentiated, these being the process 
or ute Hieronin and the reactive or benign 
stated a he hypothesis has usually been 
Study, but the dichotomous form, as in this 
Concept may well develop into a dimensional 
hi as it is clarified empirically. 
implicie  Pothesis_ has appeared explicitly or 
erature s; in psychiatric and psychological lit- 
Concept rei Bleuler [4, 5, 6] formulated the 
lin’s T schizophrenia in revision of Kraepe- 
Bleuler ; 15] concept of dementia praecox. 
yh oBnized that there were some pa- 
‘a © recovered who were classifiable as 
Praecox according to Kraepelin’s cri- 
pod, therefore, that further differentia- 
an that afforded by those criteria was 
-“tY if maximum predictability was to be 
have As Meduna and McCullough [22] 
Not been argued, Bleuler’s distinction has 
"covery Ollowed, and so the prediction of 
or de one those diagnosed schizophrenic 
as it mip} 2 Praecox has not been as effective 
r Bit have been. 
ne ot [16] and later Mauz [21] held 
lieving œD of the process-reactive view, be- 
Ponder. fs at true schizophrenia occurs pre- 
body antly in those of asthenic or dysplastic 
Schizop Pe. These authors thought that reactive 
ti Tenia occurs in those whose constitu- 


lon 
true oes not render them prone to develop 
Schizophrenia, 
Tp, 
Palo ae the Veterans Administration Hospital, 
to, California. 


Lewis [20] in his 1936 review of dementia- 
praecox researches arrived at the conclusion 
that investigation of the process-reactive hy- 
pothesis was a major indicated direction for 
further research. 

Langfeldt [17] has published evidence in 
favor of the process-reactive view, finding that 
previously identified atypical cases of schizo- 
phrenia improved much more than typical 
cases. Langfeldt, in later papers [18, 19], has 
presented evidence that indefinite schizophren- 
ia, with a favorable prognosis, can be differ- 
entiated from definite schizophrenia. 

Milici [24] and Paskind and Brown [25] 
report cases diagnosed as schizophrenia in 
which the precipitating environmental stress 
or shock was known and where recovery or 
remission was relatively early and complete. 
Reports of many such cases were frequent dur- 
ing and after World War II and will not be 
cited. The inference based on these studies has 
usually been that there is a schizophreniform 
psychosis which develops suddenly and in re- 
sponse to relevant stress and which does not 
follow the classical course, and that many cases 
of so-called typical schizophrenia are so classi- 
fied mistakenly. 

Extensive studies of the childhood histories 
of schizophrenics with a view to implications 
for prognosis have been reported by Wittman 
[26, 27] and by Wittman and Steinberg [28 
29]. These studies carry on in the tradition 
of Meyer [23], as do studies of Hoch [8] and 
Kasanin and Veo [12]. The view that the 
shut-in personality and onset at early ages are 
characteristic of the process group is supported 
by the results of these studies. Similarly, Hunt 


157 


158 


istinguished a group of pa- 
and 2 ppel Sp aes a schizoaffective and 
a e poorer environmental adjust- 
pa ra to illness was associated with poor 
rognosis. 
i pea investigators who have found that 
prognosis in schizophrenia is related to the 
nature of the onset, Kant [10, 11] is notable. 
Unrecovered cases were characterized by grad- 
ual onset or a unique precipitating cause, 
whereas recovered cases had developed in the 
Presence of pertinent stress. Kant has also pre- 
sented evidence that Bleuler’s criterion of a 
clear sensorium differentiates the non recovering 
group from those with better prognoses. This 
conclusion is supported also by evidence from 
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Langfeldt [17] and Hunt and dips US ae 
A somewhat different type of evide os tae 
resented by a survey of the ea 5]. 
pital remission rates reported by AS 
He found that about 40 per cent 0 ane 
schizophrenics seem to remit ee at tO 
while about 60 per cent of such cas r ak 
remain unimproved or Gota Mee 
argued that such statistics support th 
reactive hypothesis. ; eat t0 
References to additional studies Lge : 
the process-reactive view will mae age id 
Bellak’s [1] recent summary volun ein of this 
the general conclusions are in pe B 
general point of view. Ebaugh an 


enjan” 
0 
ee roups 
[7] had previously identified four 8 


Table 1 


Items Defining Frame of Reference for ( 


Jase History Judgments. 


Process Schizophrenia 


Reactive Schizophrenia 


Birth to the 


fifth year 
a, Early psychological trauma a. Good psychological history 
b. Physical illness—severe or long b. Good physical health 7 
c. Odd member of family c. Normal member of family 
Fifth year to adolescence i 

a. Difficulties at school a. Well adjusted at school ied by behav 
b. Family troubles paralleled with sudden b. Domestic troubles pata om it took.’ 

changes in patient’s behavior disruptions, Patient “had wha nd interest g] 
c. Introverted behavior trends and interests ¢. Extroverted behavior trends shysica , 
d. History of breakdown of social, physical, d. History of adequate social, P 

mental functioning functioning 
e. Pathological siblings e. Normal siblings - mother 
f. Overprotective or rejecting mother, $ Normally protective, accepting 

“Momism” 
& Rejecting father & Accepting father 

Adolescence to adulthood t aod 

a, Lack of heterosexuality a. Ileterosexual behavior names prese” 
b. Insidious, gradual onset of psychosis without b, Sudden onset of psychosis; $ 

Pertinent stress Pertinent. Later onset 
c. Physical aggression ¢ Verbal aggression 
d. Poor Tesponse to treatment d. Good response to treatment 
e Lengthy Stay in hospital e. Short course in hospital 

i Adulthood 

z =e Paranoia a. Minor paranoid trends i m 
G ittle i . e 
c No i a for alcohol b. Much capacity oe si compo” 
d Fail nic-depressive component c. Presence of manic-depres , eme”! 
e Dis ure under adversity d. Success despite adversity ait achiev 
i ‘cen ae ability and achievement ¢. Harmony between ability ‘ 
& Somatic delusion” i Self f. No sensation of change ions ronm?” 
4 Clash ni ‘usions , &. Absence of somatic delus oa vir 
: A een culture and environment h. Harmony between culture 

ates) ‘cency (nudity, 

i 


public masturbation, 


Retention of decency 
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schizophrenics as defined by the course of the 
disturbance. Just how many types of courses 
Mars are in schizophrenia is thus left in doubt. 

he present paper uses a dichotomy for con- 
venience, 

It is apparent from the literature available, 
that there are some patients who present & 
DEOR complex very similar to the tradition- 
A essai syndrome, but who to some 
nosis E degree have a more favorable prog- 
Schizo hr one were to formulate a reactive 
es syndrome, it would contain the 
sonalit ee ements: (a) the prepsychotic per- 
of e was relatively normal, (b) the onset 
mg iis was sudden with logical pre- 
4 aeng factors present, and (c) the patient 

maintain a clear sensorium. 

the oe pant study stems most directly from 
out that ta Benjamin [2], who has pointed 
ing inki Ss Rorschach test is useful in reveal- 
Patients ae disorders and who finds that some 
of oe schizophrenic on the basis 
thinkin ie examination do not display 
Slight A isorders or display such signs in 
latita Signs of thinking disorders are 
and the y independent of the stage of illness 
Patient, e clinical condition of the 
all so-cal] ar are, to be sure, found in almost 
en, ooe deteriorated cases, but are also 
imes, in less pronounced form, at 


Ver 
dine y stages, occasionally long before a 
after, diagnosis has been made, as well as 


a clinical recovery from a severe attack” 
Process a Thinking disorders may well be 
€ abse ymptoms according to Benjamın and 
tive of i of such signs may well be indica- 
Study oe schizophrenia. In the present 
similar nonpsychotic Rorschach diagnosis 1s 
„to Benjamin's absence of thinking dis- 
and ie rag indicative of reactive schizophrenia, 
Jamin’, oo of psychosis 1s similar to Ben- 
tive o inking-disorder diagnosis, 1. indica- 
Process schizophrenia. 


Problem 


~ © study reported here is concerned with 
questions which arise if one entertains 
P Tocess-reactive hypothesis. 
mination diagnoses based upon Rorschach ex- 
n alone label as nonpsychotic a portion 
diagno Population of mental patients who are 
sed clinically as schizophrenic? 


= 


2. Can case histories of clinically diagnosed 
schizophrenics be differentiated into two cate- 
gories: reactive and process? A search of the 
literature revealed criteria which were used as 
the frame of reference in ratin™ cases as process 
or reactive from social service case histories. 
The criteria are given in Table 1. 

3. Are those cases rated psychotic from the 
Rorschach classified as process on the basis of 
the case histories and those cases judged non- 
psychotic from the Rorschach classified as re- 
active from the case histories? 


Method 


Subjects. Two successive samples of sub- 
jects were studied. The first consisted of all 
patients at the Palo Alto Veterans Hospital 
who were diagnosed schizophrenic and who 
were given Rorschach tests during 1948, a 
total of 180. The second sample is all of the 
schizophrenics (clinical diagnosis) given the 
Rorschach during the first six months of 1949 
at the same hospital. There were 147 such 
patients, three of whom were used in the first 
sample, giving a second-sample total of 144. 

Any patient who could be placed in any of 
the following categories was eliminated from 
the study: (4) diagnosis of latent schizophren- 
ia (4 cases), (b) diagnosis made from a bat- 
tery of tests rather than the Rorschach alone 
(56 cases), (c) less than seven main scorable 
Rorschach responses (29 cases), (d) diagnosis 
of schizophrenia complicated by a secondary 
diagnosis (9 cases), (e) change of clinical 
diagnosis before an arbitrary date, i.e., May 2, 
1949 for the first sample and August 1, 1949 
for the second sample (23 cases). In all, 108 
first-sample patients and 95  second-sample 
cases were retained for rating. 

Diagnostic procedures and ratings. The psy- 
chiatric diagnoses were established on the basis 
of data collected by all appropriate services of 
the hospital, including psychological examina- 
tions. In each case, diagnosis was decided at 
a staff conference including representatives of 
all relevant hospital services and a psychiatric 
consultant. The final diagnosis was reviewed 
by the chief of psychiatry of the hospital. 
These diagnoses did not enter into the study 
directly, but defined the population for study 

‘The Rorschach diagnoses were made on the 
basis of tests given by trainee psychologists 
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each of whom had adequate ee 
in administration of the test. Analysis o the 
im ro pe carried out by the person testing 
ates the assistance of an advanced ae 
The final formulation and the protocol on 
which it was based were then reviewed by a 
staff psychologist who had prior interpretation 
experience with more than five hundred Ror- 
schachs. The analysis criteria used are those 
outlined by Klopfer and Kelley [13]. 
The two judges who rated the case histories 
for the first sample were the chief of psychiatry 
of the Palo Alto Veterans Hospital and a clini- 
cal psychologist from Stanford University. 
Each judge rated from the same history ma- 
terials at different times. There was no dis- 
cussion of the cases by the two judges and none 
of the Psychological examination materials 
Was available at the time of rating. Cases were 
Catagorized: Process, Reactive, or Cannot Say. 
The chief of psychiatry had reviewed each 
case previously, and so had seen psychological 
examination and history materials together at 
a time prior to the time of making the ratings 


for this study. The clinical psychologist judge 
had seen the complete set of materials on only 
a very few of the 


cases at a previous time. 
Both judges are familiar with the diagnostic 
habits (psychiatric and psychological) at the 
hospital. The reader must decide for himself 
just how these factors contaminate the results, 
It is the conviction of the authors that the re- 
sults were determined little by these factors. 

As of the writing of this paper, the second 
sample has been rated only by the clinical psy- 
chologist judge. Before making the ratings, he 
ad contact with 


l only two of the patients and 
their Rorschach records and had seen none of 


the history materials of patients used in the 
second sample, 
Results 


Diagnoses ba 
label 
the populati 


ted process or re- 
d aonpsychotic and 36 
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ese 

psychotic on the basis of the Rorschach. Ti 
results are in agreement with and m cola 
conclusion stated above. This zeul itic 
tion might tempt some to be extreme oo a 
of the clinical diagnoses or the Rors tt, 
both, since there is so little agreement 
the two types of diagnoses. | ; Sie 

2. Case histories of clinically liably in- 
schizophrenics can be differentiated in 
to two catagories: reactive and ao 2, the 
relevant results are presented in t hie 108 
data being from the first sample. t a rating 
case histories, both judges arrived a a 
in 86 cases, and were in oops distribu 
these cases. A y? test, based on t on tha 
tion of cases shown in Table 2, sh 


osed 


Table 2 process 
ing 
Agreement between Judges ee 
and Reactive Schizophreni 


JudgeA tal 
Judge B Process Reactive : 
5 6 

Process 47 13 26 
Reactive a 

86 
Total 56 30 

*x2=13.40, p< .001 
Table 3 


m the 
Comparison of Judgments Ti 
Case History and Rorscha 


Judgmer g voces 
Rorschach Reactive 
Judge A (First sample) i 
Nonpsychotic 21 7 
Psychotic 10 m 
xi=7,87, SAA 
Judge B (First sample) oi 
Nonpsychotic 2 52 
Psychotic 
0i 
x2=27.55, p< m 
Judge A and B (First samp 13 
i 15 34 
Nonpsychotic 5 
Psychotic , 
x2=16.24, p<-00 , 
mple 2 
Judge B (Second s@ A 
Nonpsychotic 16 
Psychotic 


5 
001 
X2=7.24, >Z 
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this agreement is greater than would be ex- 
pected by chance. 
ieee to diagnosed as schizo- 
Ty are most pe rated reactive from the histo- 
the Rorschach a "cae nonpsychotic from 
histories are 1 i a those rated process from the 
the Rorscha a often judged psychotic from 
ata, "The tna Table 3 contains the relevant 
the case ins sagt judgments made from 
Orschach sae and those made from the 
ment iban bie i oe are in greater agres- 
is the case a pii expected by chance. This 
and for the © Sach judge on all rated cases 
which both ; cases from the first sample on 
judges agreed. 


Discussion 


The 
this central problem under consideration in 
Conception a e status of the reactive-process 
this idea js oS schizophrenia. It is clear that 
Clear i ag ina crude form. It is equally 
It is the alnis general idea has persisted, and 
the viey ton of the authors that persistence 
“valuation v in the light of critical clinical 
iS, our pr mies some validity. Granting 
an empirical ae becomes the clarification, on 
n this St reat of this view. 
TOCeSs-react! y, some questions relevant to the 
Mpirically tive view have been investigate 
rine tp ee full realization that the im- 
Oubt. TH the findings would be in some 
are subject procedures employed in this study 
have c t to some criticisms, most of which 
Study ie mentioned. For these reasons the 
It w st be viewed as preliminary in nature. 
R renicg , determined that diagnosed schizo- 
l OS Ria be further separated into the 
labilit brocess and reactive with some re- 
tnt to indice information is available at pres- 
ese cate icate with precision the meaning © 
active bee Zories. One thought is that, the re- 
Process ses are either milder or earlier, than 
Pinion mg If Benjamin is correct 17 his 
Ieators Bap the presence or absence of in- 
depende of thinking disorders is relatively in- 
and j nt of duration and degree of illness, 
Show ¢ as our data suggest, the Process, cases 
ive Vidences of thinking disorders while re- 
active coss do not, then the equating of re- 
l ast į with early or mild schizophrenia is at 
nsufficient and is possibly incorrect. 


en . i 
Jamin’s work led him to adopt the point 
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of view that schizophrenics with thinking dis- 
orders as measured by the Rorschach are apt 
to follow the classical dementia praecox course, 
whereas those who do not show thinking dis- 
the Rorschach tend to follow an 
some degree of recovery. 
We have not presented evidence directly rele- 
vant to this point, but a brief follow-up of our 
patients does indicate a higher rate of discharge 
from the hospital among cases called reactive 
than among the process cases. 

The judgments of the case histories made 
in the present study were based on premorbid 
the nature of the illness to some 
n some knowledge of the course 
The latter information was 
a part of our histories since most of the cases 
had been hospitalized in the service; better 
samples of cases would be groups of first-ad- 
The judgments of the Rorschach 
performances in this study were based in part 
on criteria of thinking disorders, but also upon 
general personality structure and function. 
The agreement with the results of Benjamin 
[2] is found even though the methods are not 
strictly parallel. This suggests that the general 
conclusions can be held with some confidence. 

A brief comment on the lack of agreement 
hach and the clinical diag- 
noses is perhaps in order. Suffice it to say that 
such agreement could undoubtedly be system- 
atically varied depending on the particular 
diagnostic approaches used. There is no reason 
to believe that the diagnostic approaches at the 
hospital where this study was made are atypi- 
cal in any important ways. It would seem that 
the Rorschach alone, as conventionally used, 
would be an inadequate criterion on which to 
base a psychiatric diagnosis. It seems equally 
clear that the Rorschach provides a relatively 
economical way of adding important data re- 
garding the particular variety of schizophrenia 
being dealt with. 

‘An additional implication of the results of 
the present study, taken with other evidence 
is that diagnosis as usually practiced is hee 
sufficiently specific to give maximum differenti- 
ating information about schizophrenic patients. 

Summary 

‘Two samples of schizophrenic patients were 
studied. In each case, the patient was classified 
as reactive or process on the basis of the history 


orders on 
atypical course with 


personality, 
extent, and o 
of the disorder. 


mission cases. 


between the Rorsc 
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and psychotic or nonpsychotic on the basis of 
the Rorschach. The following results were ob- 
tained: 


als 


Schizophrenic cases can be reliably dif- 


ferentiated into:process and reactive groups. 


2. Those cases classified as reactive from 


histories tend to be called nonpsychotic from 
the Rorschach. 


3. Those cases classified as process from 


histories tend to be called psychotic from the 
Rorschach. 


These results support the view that the diag- 


nostic category of schizophrenia can be legiti- 
mately elaborated to include the classifications 
reactive and process. There is evidence that 
process and reactive cases differ in their psy- 
chological-function characteristics. 


On the basis of these results, further analyti- 


cal study of the reactive-process hypothesis is 
indicated. The full implications of the agree- 
ments demonstrated can be derived only from 
these further studies. 
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Mo Eai r of the present study is to re- 
of A il seen a between certain aspects 
ospitalize = obtainable from the records of 
o treatnaern Se amy patients and the outcome 
and the or af he feasibility of such a project, 
against ie objections which can be raised 
Side the nth a approach to prognosis, are out- 
Nat in the vince of this study. Suffice it to say 
Over 500 es of planning the present study 
Used Aa lished papers were read which 
empt to ra gee from case records in an at- 
his volumin, prognostic criteria. In spite of 
‘stressing PER literature, however, there is a 

he ida carth of definitive studies. 
ata upon which this study is based are 


Pree: : 
ario 
us. In the seven years covered by the 


Study g; 

y * 
Social Sieni psychiatrists and psychiatric 
Paciti orkers of varying conceptions and ca- 


Sisko ee to the materials which 
ave cha e case histories. Admission policies 

langed. Ideas of treatment have fluctu- 
Studies T criticisms apply to other similar 
> Nevertheless, this approach to the 


Stud 
Popular Prognostic criteria continues to be 
Sener: and has, indeed, resulted in several 


e accepted and repeatedly found prog- 
38 Spe e.g., duration of illness [3, 24 
and ay ods presence of affect [51, 49, 31, 271, 

iteness of onset [26, 45, 46, 481- It's 
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however, that the methodology 
does not make maximum use 
in addition, tends to obscure 
the relationships which may 
d outcome of treat- 


our contention, 
usually employed 
of the data and, 
rather than define, 
exist between variables an 


ment. 
We may, to illustrate our point, consider a 


specific variable, duration of illness, which has 
been generally found to be related to outcome 
of treatment both for the schizophrenic [3, 4] 
and manic-depressive [43] disorders. The us- 
ual procedure is to relate duration of illness to 
outcome of treatment without consideration of 
variables which might affect outcome of 
treatment. The general finding has been that 
the shorter the duration the greater the chance 
of the patient to recover from his illness. Such 
findings have led to the oft held belief that 
early treatment is the key to recovery in mental 
illness. There is some evidence, on the other 
hand, to indicate that duration of illness as a 
prognostic variable may be an artifact. Witt- 
man [53], for instance, in her extensive studies 
of prognosis, found a number of process schizo- 
phrenics with unfavorable outcome to be in the 
short-duration group. In a study comprising 
960 cases, she found 134 with short duration 
who did not improve. She feels that by the 
usual statistical methods employed, the patients 
with a longer duration of illness include a 
heavier weighting of process schizophrenics, 
which gives long duration its poor prognosis. 

The need is clear, we think, for better-con- 
trolled studies of such variables as duration of 
illness, mode of onset, age of onset, marital 
status, precipitating stress, etc. If data obtained 
from case records are to be used in'a search 


other 
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for prognostic criteria, then more valid meth- 
ods of study should be employed. When a 
variable such as duration of illness is studied, 
other variables, known to be related to out- 
come of treatment, need to be held constant. 
Such a statement does not mean to imply that 
all the variables which may affect outcome of 
treatment can be held constant while a single 
variable is being studied. Sufficent knowledge 
to encompass such a possibility, if it were 
feasible, is not now available. We do wish to 
state, however, that a much clearer notion of 
the relationship between duration of illness and 
outcome of treatment can be obtained if all the 
other variables obtainable from a case record 
and known to affect outcome are held constant 
while the duration is varied. 

The present study, of which this paper is 
the first in a series, attempts a controlled study 
of prognostic criteria obtained from case-record 


G. R. Pascal, C. H. Swensen, D. A. Feldman, M. E. Cole, and J. Bayard 


material. Variables known to be significantly 
related to outcome of treatment are extracte! 
from case records. Single variables are ome 
while other significant variables are, insofar 
possible, held constant. 


Method and Procedure 


‘The Western Psychiatric Institute $ 
Clinic (WPIC) was opened in por f 
1942. The records of all patients admitte 
the hospital who were discharged u of 
than July, 1950 (to allow for a min hese 
one year follow-up) were examined. selec 
comprised 1118 records. T'he following 5 
tive criteria were now applied to the re 


age—15 to 55 

lack of known cortical damage 
absence of mental deficiency p 
absence of incapacitating somatic ill 
absence of previous attacks of ment 


ness 
al illness 


‘Table 1 


Total Population: Status One Year after Discharge 
According to Diagnostic Category 


y 
Status |. 
, 3 fean 4 
Diagnostic Category Sex Mean aT Gn after da Pp: 
ivica 7 
N M F age grades) Imp, 
Schizophrenics sf 
Paranoid 123 6 36 2 
Catatonic 76 = 4 332 tl 38 # 
Hebephrenic 32 19 i a 9.8 5 i 
i 5i i 
Simple 11 7 4 26.8 13.2 ; 
Mixed 22 ; : s 1 
m , 7 15 29.3 113 
Total schizophrenic 264 135 129 29.3 10.7 n 
Manic-depressives F 
Manic 18 i 
6 11.7 
Depressed 19 10 r or 10.0 = n 
Total manic-depressive 37 16 21 zA 10.8 A 11 
Involutional melancholia f A 
i 21 3 j 7.8 40 
Total affective psychoses 58 19 ie pe 9.7 E ! 
Paranoid condition 14 8 6 39.7 11.1 2 ao 
ae psychotics 3 2 1 32.3 10.7 138 
Psychotics 339 164 175 31.0 10.5 5 
Psychoneuroties 15 i 
Obsessive-compulsive 20 9 11 32.6 11.0 6 } 
Hysteria 11 3 8 27.2 10.4 7 
aed 9 5 4 29.7 11.7 17 ; 
€active depression 20 7 13 34.0 11.5 7 
Hypochondriasis 10 6 4 37.8 8.4 19 gt 
Mixed 25 10 15 33.6 9.7 7 gf 
All psychoneuroses 95 40 55 32.8 10.5 5 j 
Behavior disorders 52 25 i 9.6 38 A 
All nonpsychotic 147 65 a sings 10.2 4 
li abeft 5 82 29.5 ‘ 23 


486 


10.4 


257 30.5 
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The last criterion requires some explanation. 
The WPIC is primarily a referring hospital. 
Most of its patients come from other hospitals. 
The criterion “absence of previous attacks of 
mental illness” does not, therefore, mean that 
the patient was first hospitalized at WPIC. It 
means that upon admission to WPIC the pa- 
tient was suffering from one continuous attack 
of mental illness without known prior attacks 
which resulted in referral to a psychiatrist. Ap- 
plication of these criteria left 486 cases avail- 
able for further study. 

Table 1 shows the composition of the 486 
SBSES. The table shows the sex, mean age, mean 
education in grade years, and status one year 
after discharge by diagnostic category. Our 
one at this point of discussion, centers 
ee ut the representativeness of the sample with 
ace outcome of treatment. The sample 
pee ria 264 schizophrenics. Of these, 91 or 34 
dabh improved, This figure compares fav- 

y with that of Taylor and Van Salzen 
ic =n ao study contained 1100 schizophren- 
com > 37 per cent of whom were able to 

plete, successfully, one year of parole. 
sl the schizophrenic group, only the cata- 
to rel and paranoids are in sufficient number 

elate to other studies. Of the 123 paranoids, 
ics i 9 per cent improved. Of the 76 cataton- 
ential Ses 50 per cent improved. The differ- 
eepin etween catatonics and paranoids is a 
taine, a pam expectancy based on results ob- 

The y other investigators [40, 33]. 
disorde sample contains 58 cases of ate 
Der i various types. Of these, 41 or 
is too t improved. The total number of cases 
is Soe for any valid comparisons, but 1t 
Prove th noting that the increased rate of im- 
koun Get in contrast with the echizophren' 
or th 15 im accordance with expectancy i 
Orde e involutional and manic-depressive @1S- 

rs [20, 17, 12]. 
cent the 147 nonpsychotic cases, 96 or 65 = 
Ow- Proved. Ross [39], in a one-year F 

1p of 1186 hospitalized neurotics, foun 
thie cent improved. The several subtypes in 
Com category contain too few cases for va n 
nog arisons with other findings. It is wort 
is f Be however, that the highest eor 
tn for reactive depressions, whic 
ance with expectancy. [23]. Me 
hese findings lend credence to the validity 
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of our criteria, a crucial consideration in a 
study attempting to relate case-history variables 
to outcome of treatment. This correspondence 
between our findings and those of other in- 
yestigators may be thought of as an estimate 
of the reliability of our criteria of improve- 
ment. 

Criteria of improvement. A patient was 
considered improved if, one year after dis- 
charge from the WPIC, he was working at a 
level of efficiency roughly equivalent to that 
which obtained prior to illness. He was con- 
sidered unimproved if, one year after discharge 
from the hospital, he was in another mental 
hospital, or, if not in a hospital, then incapaci- 
tated to the extent of being unable to be gain- 
fully employed, or manifesting other behavior 
indicative of inability to cope with his environ- 
ment in comparison with expectation of a per- 
son of like status. Only the dichotomy “‘im- 
proved” —“unimproved” was used. Borderline 
cases were judged, on the basis of available 
evidence, to fall in one category or the other. 
Most judgments, particularly for the im- 
proved, were made on the basis of observations 
made by psychiatrists or psychiatric social 
workers and recorded in the case records. The 
unimproved were judged, for the most part, on 
the basis of reports from other mental hospi- 
tals to which the patients had been transferred. 
This procedure was followed for 445 cases on 
whom follow-up material was available one 
year after discharge. Forty-one cases were 
judged by the following criteria: if the patient, 
on discharge from this hospital, was trans- 
ferred to another hospital, unimproved with 
recommendation for commitment, and no fol- 
low-up information was available, the patient 
was judged unimproved ; if the patient was dis- 
charged from this hospital, improved, and re- 
leased to return to his previous or other similar 
environment, and no follow-up information 
was available, the patient was judged im- 
proved. 

The variables. The variables used in the 
study represent a compromise between those 
variables deemed important from a considera- 
tion of evidence in the literature and the prac- 
tical job of culling reasonably reliable infor- 
mation from the records. The variables are list- 
ed below. Definitions are given where indicat- 
ed. In some cases only a brief, orienting defini- 
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tion is given; these are the variables which will 
be given later, fuller treatment. 


1. Sex 

2. Age at admission to WPIC 

3. Marital statu’—three categories: single, mar- 
ried, divorced, or widowed 

4. Religion—Catholic, Protestant, Jewish, or 
Greek Catholic 

5. Nationality—of the patient or his parents: 
American; North European including France, Ger- 
many, British Isles, Low Countries, Scandinavia, 
Austria; South European including Italy, Balkan 
countries, Spain, and Portugal; East European in- 


cluding Russia, Poland, Czechoslovakia, Hungary, 
and Baltic States 


6. Occupation—four Categories: professional, in- 
cluding teachers, ph ysicians, lawyers, engineers, sci- 
entists, artists, musicians; semiprofessional, includ- 
ing businessmen, salesmen, college students, bank 
tellers, dieticians, Secretary (college graduates), 
etc.; skilled, including machinists, electricians, sta- 
tionary engineers, cranemen, clerks, chauffeurs, ste- 
nographers, miners, high-school students; and un- 
skilled, including day laborers, handymen, farm- 
hands, domestic, unemployed, grade-school students 

7. Economic level—four categories: comfortable, 
average, marginal, dependent 

8. Body Type—only height and 
available in the records, 
crude estimate of body t 
Following Sheldon’s 
over cube root of weight would give an esti 
body type for the earlier years, this ratio wa 


weight were 
With these data only a 


as not used. In an 
attempt to obtain a more valid measure of this varj- 


erage, average, and below average, 

11. Affective e 
ate this variable, Briefly, an attempt 
e the amount of affect displayed by 


receive detailed 
a later paper of t 2 study [2]. 


on was used to place the patient into 


one of two categories as follows: oriented, not 


oriented. 


13. Direction of aggression — a nine-point scale 
Was constructed to rate this variable. Briefly, an at- 
tempt was made to rate whether the direction of 
aggression displayed by the patient was towards 

imself or others. This variable will receive de- 
tailed. treatment in a separate, later paper [10]. 
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14. Diagnosis—the patient's final oy 
reached by agreement between the aE Rane 
chiatrist and the clinical director, or on | paychi 
of a staff conference attended by several ps) 
atrists r ss—the 
nr Patient's age at onset of mental ie sie 
opinion of the attending psychiatrist and/o 
hiatric social worker A 
s 16. Type of onset—a nine-point scale cana i 
to rate the continuum running from ae aataile 
sidious onset. This variable will receive 
treatment in a separate paper [+7]. opinion 
17. Duration of the patient's illness—the Tait 
of the attending psychiatrist aiko BAPE case 
social worker and reported as such in f a later 
record. This variable will be the subject © 
aper. 
P P Total time of hospitalization—the S hospita 
in months, spent by the patient in a menta the psy” 
19. Status on discharge from pire im- 
chiatrist’s opinion of the patient's con improve 
mediately upon discharge. Categorized as 
or unimproved. . int scale com 
20. Precipitating stress—a nine-poin ntal stress 
structed to rate the amount of ae regeding 
experienced by the patient immediate a receive 
the onset of illness. This variable Ye] 
detailed treatment in a separate paper [6 satient— 
21. Amount of treatment received by ne pa 
three-point scale. Point one: routine ee thera” 
including psychiatric interviews, aie NT ig 
Py, and hydrotherapy. Point favo: eee ete 
therapy, insulin therapy, metrazol vefront Job 
Point three: somatic therapies plus pre 
otomy. 


cted 


otal time 


1 cares 


salf 
itse 
p $ cern 
This paper of the series will na ach 
with reporting the relationship Eo e 
of these variables and the outcor 


+ es? 
iqu! 
‘ ar techni” 
ment, using appropriate statistical i 


at! 
y on interre e ag 
It will, in addition, report the "i to ae 


e 
ships between those variables foun tment- po 
nificantly related to outcome of am. é! A 
this purpose a p value of .01 he Tip: at 
dicative of a significant rela and th 
Papers will report on single varia nt wher re 
relationship to outcome of treatm ilary A 
the other variables found to be $ ossible- na 
lated are held constant, insofar A the © 
final paper will present a discuss! 


e usions- 
tire study, summary, and concl 


e ion 0 
Results and Discuss!0 ed t 


elat! í- 

Each of the 21 variables yas de hoe 
status one year after discharge 110 e was © 

tal. Where the independent variab © e it Wee 

gorized, chi square was used; V 


co 
F ine Jation 
continuous, the biserial corre 
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aoe Table 2 shows the results of statisti- 
to be oe Of the 21 variables, 10 seem 
ity values of 02e i criterion, with probabil- 
sex, age 2 farts or greater. These variables are 
niad ft gar nationality, occupation, eco- 
Status, and . ody type, education, intellectual 
teks date of onset. We shall not consider 
ae erie (Gs Suther except to note that simi- 
each PE T in the literature for 
ody type Rl 3, 45, 42, + 16] except that for 
ationship ob or what it is worth the low re- 
ud and Re ee to agree with Malam- 

ST. ike re [28] and Kline and Tenny 
in end ‘Feport a tendency for patients high 

omorphy to have a poor prognosis. 


Table 2 


Status Indeperident Variables Related to 
Dne Year after Discharge from WPIC 


Vien: 
triable Statistic p Value 
L. Se 
2 i chi square = 5.59 02 
3, Mari Trig = 04 .05 
4, Rae status chi square = 12.87 01 
5. Bef chi square = 7.48 10 
6. a tility chi square = .90 .90 
A ri chi square = saz .20 
8. ku a level chi square 4.57 30 
S. Bauan bia os -05 
10, a This 10 -05 
e ntellectual bis 
Status 
1. Affccti chi square 3.30 -20 
ectiye exe Ty, 32 01 
wy eee ba 
13. mentation chi square = 16.54 001 
Irection of 
14, a This = 67 01 
15, ‘agnosis chi square = 49.45 01 
16, peo Of onset rpi 09 05 
7 ype of onset This = 31 01 
` “uration of 
18, ier i iii = 38 01 
Spital sta = 37 M 
19. Status on dis- re i 
F s 
20. harge chi square = 244.65 001 
recipitating r}; = 2 
ài Stress bis 
-Treatment 1642 001 


Ter two impressive recent studies, how- 
gest that 8], and a third older study [21] sug- 
to int i t outcome of treatment may be related 
ity Ta lectual status. We suggest the possibil- 
mate at if obtained IQ’s are used as an esti- 
ef of intellectual status, a relationship may 
ound between IQ scores and unfavorable 


outcome, because of the possible relationship 
between severity of illness and psychological 
deficit [19, 37, 35]. The discrepancy between 
the present findings and those reported else- 
where may be due to the fact chat in the pres- 
ent study an attempt was made to assess intel- 
lectual status prior to the onset of illness. 

Eleven variables were found to be related 
to status one year after discharge at acceptable 
levels of confidence. Table 4 shows the perti- 
nent interrelationships between variables. Five 
of these, affective expression, direction of ag- 
gression, type of onset. duration of illness, and 
precipitating stress, will be the objects of de- 
tailed study and presented in separate papers. 
The other six will be dealt with here. 

Marital status. The results obtained, ex- 
pressed in percentages, are contained in Table 
3. These results suggest that the divorced or 
separated and the single patients tend to have 
a less favorable prognosis than the married 
ones. These results accord with expectation 
based upon other reports in the literature [30, 
16, 21, 28]. Wall [49] suggests that history 
of some attempt at sexual adaptation tends to 
indicate a good prognosis. 


Table 3 
Percentages of Patients Improved and Unimproved 
for Marital Status, Orientation, Diagnosis, 
Discharge Status, and Treatment 


Status 1 yr. 


Criterion after discharge 
N Imp. Unimp. 
Marital Status 
Single 275 41% 59% 
Divorced, Separated 41 39 61 
Married 170 56 44 
Orientation 
Oriented 413 50 50 
Disoriented 73 27 73 
Diagnosis 
Schizophrenia 264 34 66 
Other psychoses 75 71 29 
Nonpsychotic 147 65 35 
Discharge status 
Improved 257 80 20 
Unimproved 229 8 92 
Treatment Rating 
1 147 47 53 
2 300 50 50 
3 = 30 16 ° 34 
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Orientation. This variable seems to be sig- 
nificantly related to status one year after dis- 
charge. The disoriented patients, as defined, 
tend to have an unfavorable Prognosis. Little 
relationship is found between orientation and 
outcome if the patient is oriented, as the tabu- 
lation in Table 3 indicates. A number of previ- 
ous reports can be found which tend to support 
these findings [52, 51, 49, 27]. On the other 
hand, an even greater number of previous 
studies seem to argue against acceptance of the 
present findings [31, 22, 16, 13, 5, 4, 3]. The 
weight of the evidence in the literature seems 
to favor a relationship between good prog- 
nosis and confusion, clouding, perplexity, bi- 
zarreness of behavior, in fact, all the behaviors 
which might contribute to what, in the present 
study, has been categorized as disorientation. 
Orientation is, we feel, the kind of variable 
that will give results which are apt to fluctu- 
ate, depending on other characteristics of the 
population sample. 

The prognostic value of disorientation prob- 
ably depends upon how and in what context of 
other variables disorientation is displayed. 
Thus if delusions accompany disorientation, 
then there is evidence to indicate the type of 
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delusions displayed influences prognosis [1]. If 
hallucinations contribute to disorientation, then 
there are indications that visual hallucinations 
are less ominous than auditory [51]. Table 
indicates that orientation is significantly relate 
to a number of other variables which are go 
selves significantly related to outcome. i 
might, for the sake of example, take the on 
tionship found between direction of ie 
and orientation. For those patients eigen 
disoriented, 70 per cent directed their ae 
sion towards others, 23 per cent did not - 
their aggression primarily in any one direc 2i 
and 7 per cent directed their appren is 
towards themselves. The implication her! pe 
clear that disorientation in our sample 8 In 
lated to behavior indicative of bag ae 
the same way it could be shown that ame 
tation is related to lack of precipitating san 
lack of affective expression, and the a 
of schizophrenia. We do not feel, in jente 
words, that the fact that a patient is isi 
or disoriented for time, place, and on it 
the time of the mental status is, by ‘hich to 
particularly significant datum upon cle 
base prognosis. It is difficult to see how tation 
notion of the relationship between orien 


Table 4 


Interrelationships between Significant Variables with Probability Values} 


Prec. 


eee 24% 109.7 06" 269 
>.05 254 
Orient B2 mue 128 55.9 10.6 4.2 6> 
>.05 = 18.9 
Dir. agg. 24" 128 132.9 20% 243 23 ei 
Diagnosis 109.66 559 1329 ae 11.9 11.3 D 
<02 >05 <O gg 
Type onset .05* 10.6 .20* TA ae 33 a 
>.05 <05 395 
Dur. ill 269 4.2 24.3 1126 79.8 ee 19 
>.05 >.05 i 
Precip. stress 18* 6.5 .23* 12.9 ie WS =e 2 
P <.05 <.02 <.05 a 
Treatment 15. 3 
57 25.4 18.9 57.6 19.3 23.5 >.50 1.44 
Marital status 35.18 4.21 9.41 5.84 6.10 4.25 2224 <2 
<.20 <.05 <.10 <.05 <.20 
Correlation Coefficients. AJl thi yi 4 Š 
8 aa es indicate signifieant, relationshing ie ea values less than .01 ons 
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pn ea can be obtained unless the vari- 
By: the = oe to it and outcome are controlled. 
fdk oS token, the significant relationship 
ae pa ge orientation and outcome points 
ole need to control for this variable in 
ying the relationship between other vari- 
ables and outcome. 

et set The patient’s diagnosis is signi- 
dime seni i to status one year after dis- 
ese he ae le 3 summarizes the findings. 
Se a x ings are in accordance with expect- 
ia kaa ea ine studies have already 
significant] : able 4 shows that diagnosis is also 
orientati ‘ _— to affective expression, 
of fae direction of aggression, and amount 
schizophrents given. Of the three categories, 
Pression ni me tend to have less affective ex- 
towards othe direction of their aggression 1s 
Orientation hers, they tend to show more dis- 
Rach of d and to be given more treatment. 
any annl variables must be controlled in 
iagnostic study of the relationship between 
tis our category and outcome of treatment. 
Posed, it Ry that if such controls are im- 
category Ma T relationship between diagnostic 
of deeaa’s such variables as affect, direction 
iagnosis “ip type of onset, etc., which gives 
Noting i a N validity. It is worth 
ationship y in this study, a nonsignificant re- 
gory and Hes found between diagnostic cate- 

me snes of illness. — ; o. 
antly it ERON: This variable is sig- 
charge, The ated to status one year after dis- 
tendency fe longer the hospital stay the more 
one year or the patient to remain unimproved 
bits ate discharge. This variable is so 
Same aa te to duration of illness and the 
Illness that es which are related to duration of 
Efe, Bice we shall not consider it further, 
needs to na to note that total hospitalization 
etween ats controlled when the relationship 
tatus ner variables and outcome 1s studied. 
tendeno i discharge. There is a consistent 
Proved ¢ OF those who are discharged im- 
ischar © remain improved for one year after 
ities The same tendency applies to those 
Us on ged unimproved. The prediction of stat- 
char ¢ year after discharge from status on dis- 
sia Is quite good, as indicated by the sum- 
th of findings in Table 3. The implication, 
apply į that the results of this study might also 
airly well to the immediate outcome of 
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treatment, although with a lesser degree of 
accuracy. i 
Treatment. Total treatment, as crudely 
rated in this study, seemed to be significantly 
related to outcome. As the summary in Table 
3 indicates, however, most of its significance 
derives from the great percentage of unim- 
proved in the category which comprises the 
lobotomies. There seems to be little relation- 
ship between treatment ratings one and two, 
and outcome. A number of studies can be cited 
which corroborate this finding [14, 18, 15, 9, 
5, 3], ie. that there is little relationship be- 
tween amount of somatic treatment and prog- 
nosis. A study by Danziger and Kindwall [7], 
however, suggests that the outcome of treat- 
ment in dementia praecox depends on the num- 
ber of treatments either of insulin or electro- 
convulsive therapy, when duration of illness is 
held constant. Unfortunately, our treatment 
data are too crude to enable us to check on this 


very interesting finding with any degree of ac- 
curacy. 

Table 4 shows that the treatment rating is 
significantly related to affective expression, 
orientation, direction of aggression, diagnosis, 
type of onset, and duration of illness. By and 
large, these relationships hold even when the 
lobotomies (treatment rating three) are ex- 
cluded as Table 5, relating to treatment rating, 
indicates. 

Table 5 


Treatment Received by Patients 
with Various Diagnoses 


Treatment Rating 


1 2 
routine 
hosp. physical 
Diagnosis N care therapy 
Schizophrenia 232 19% 81% 
Other psychoses 71 31% 69% 
Nonpsychotic 144 57% 43% 


It is evident, therefore, that if the relation- 
ship between other variables and outcome is so 
studied, the treatment rating needs to be held 
constant. 


Summary and Conclusions 


Using predetermined criteria, 486 case rec- 
ords were selected from the files of the West- 
ern Psychiatric Institute and Clinic. These 
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records comprised all the cases meeting 
criteria up to July, 1950. All were Pe o 
patients between the ages 15 and 55, without 
mental deficiency, without known damage to 
the cortex, and without record of previous at: 
tacks of mental illness. The patients’ statuses 
one year after discharge from the hospital were 
determined and categorized improved or un- 
improved. The records were examined and 21 
variables extracted which were, by appropriate 
statistical techniques, related to status one year 
after discharge. Of the 21 variables, 11 were 
found to be of prognostic significance at the 1 
per cent level of confidence. These are marital 
Status, affective expression, orientation, direc- 
tion of aggression, diagnosis, type of onset, dur- 
ation of illness, length of hospital stay, status 
on discharge, Precipitating stress, and amount 
of treatment. The interrelations between these 
variables are presented and discussed. 

The Primary purpose of this study is to 
demonstrate methodology, Emphasis is given to 
the demonstrated need to control for other sig- 
nificant variables while the Prognostic signifi- 
cance of a single variable is being studied. The 
present section of the study has been concerned 
with the presentation of significant variables 
and their interrelationships, Other following 
sections will present carefully controlled stud- 
ies of well-defined, single variables and their 
relationship to status one year after discharge, 
A final section will summarize the findings 
and, by statistical techniques, suggest the most 
efficient combination of prognostic variables, 
Received October 6, 1952. 
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Most persons who have to do with selection, 
training, or supervision agree that the crucial 
factors which differentiate between good and 
poor workers have to do with personality 
rather than skill and information. This is 
particularly true in the case of workers in such 
fields as teaching, social welfare, nursing, and 
counseling and guidance. However, we have 
had relatively little success so far in devising 
methods and devices which can measure the 
dimensions of personality that are essential 
to professional success with any great degree 
of validity and reliability. 

This study is the report of an attempt to 
develop a method of measuring insight and 
empathy—two qualities or abilities essential 
to the successful conduct of any profession con- 
cerned primarily with interpersonal relations, 

The test or method which appeared promis- 
ing is one devised by Rosalind Dymond [3, 4]. 
Dymond employed a cross-questionnaire type 
of test administered to a group of 80 people, 

subdivided into smaller groups of 4 each. After 
a brief acquaintanceship period, each member 
of the subgroup was asked to compare him- 
self on a five-point scale with each other mem- 
ber of the group with regard to six different 
qualities : superiority, self-assurance, leadership, 
friendliness, sympathy, and tension. He was 
asked to repeat these six comparisons in a 
slightly different way in each of the four sec- 
tions of each questionnaire. In the first sec- 
tion, he was asked to compare himself to an- 
other person in the subgroup, whom we shall 


1The authors wish to acknowledge the help of 
graduate students at San Francisco State College 
who aided in assembling the data on which this 
study is based: Charles Smith, Jack Nakashima 
Donald Kase, Donald Crosby, and Richard Gilberg. 


call the referent; in the second section, he w 
asked to compare the referent to himself; e- 
the third section he was to guess what es T 
ferent would say (“What will he say a 
compared to you?”’) ; and in the fourth sieh 
he was asked to guess the reverse of this ae 
tion (“What will he say you are, compar - 
to him?”). After each person in the i 
groups had rated or compared himself pe i 
cach other person in his subgroup, the a 
groups were rearranged and re-formed ma in 
a way that the new subgroups consisted 0 ek 
dividuals who had not been used as re 
ents. The process of comparison and ra er 
was repeated. In all, the process ao 
formed three times. In this way, each an a 
became a member of three different groups * 
interacted with nine different pales t wa 
The “empathy” score for each subje what 
obtained by comparing his predictions O 
referents would say (Sections II and men 
the questionnaire) with the actual pe = 
of the referents (Sections I and II of t scor? 
ferents’ questionnaires). The empathy | pre 
was the total number of scale-points t onses’ 
dictions deviated from the actual fag 
Thus, the higher the score (ien the E 
the error), the less the “empathy- ployed 
If the empathy is used in the sense able 
by Dymond, i.e., the “ ‘faculty’ of he! oint of 
to see things from the other person = a cel 
view,” [4, p. 344] this method possess) i 
tain face validity, in that the a ughts a 
asked to empathize, to predict the g e to se? 
feelings of another, and a check is A 
whether he has empathized correctly- cong # 


[ees E ained by ec 
The “insight” score was obtain ET Sa 


ing a subject’s judgments about hi thers 


tion I) to the judgments which © 


172 


Evaluation of Dymond’s Test of Insight and Empathy 173 


ci him (Section II). The concept of in- 
a by Dymond was Allport's cri- 
isis h . elation of what | an individual 
Seles i has to what others think he has my- 
Fe wisi many would undoubtedly object to 
i ha ness of this definition of insight, it 
alse granted that Dymond’s method of 
ra asurement of this factor also has face validi- 
Y, provided this definition is kept in mind. 


A Revision of the Dymond Test 


Wod to be undertaken in determin- 
tion pt a this test could be used as a selec- 
new ers Was to try if out ina large-scale ad- 
marae Dymond used a complete ques- 
al ee: re y some nine pages for each individu- 
Tiea administration. This meant nine 
It was aT or 81 pages for each individual. 
aree shar aet that the bulk of paper would be 
od Se. the scoring cumbersome if her meth- 
od was eer without change. Her meth- 
answer spain simplified by constructing an 
tue the statements as or- 
the fi y made on the questionnaire, but with 
ve-point scale rendered as “ABCDE. 
naive mal individual used the basic question- 
Teplie: ch like a test booklet and recorded his 
hi on the answer sheet. 
ieee was tried with two groups of 
rollment Peyr holagy students with a total en- 
tion of 71 i. The mean and standard devia- 
compare fay and 15.9 of the empathy scores 
the stand aA gee with the mean of 73.2 and 
Mond, ard deviation of 15.8 reported by Dy- 
ain students taking the test were 
ority,” oe of the items relating to “super! 
em, ù “sa they stated had no meaning for 
as the mless 1t was one of snobbery. Inasmuch 
item in Superiority” statement was the first 
Menter ae section, It was felt by the experi- 
effect on n might possibly have an evni 
Sequentl the cooperation of subjects. A 
Were i the questionnaire and answer sheet 
periorit vised so that the item relating to su- 
and y? was changed to one of intelligence 
tio assigned a medial position 1n the four sec- 
ns, 
on € second revised form of the question- 
men Was administered to two groups of fresh- 
25 and one group of upper-division students, 
in all. The mean for this group was 


71.23, and the standard deviation was 17.55. 


Here again, figures compare very favorably 
with the scores originally obtained by Dymond. 


Reliability and Validity 


A number of checks were made on the 
validity and reliability of the test. Dymond 
had reported a correlation of .63 between the 
first half and the second half of the empathy 
scores on each sheet, and a correlation of .82 
between scores on items 1, 3, and 5, and scores 
on items 2, 4, and 6 [4]. She also reported 
a test-retest reliability of .60 for an earlier 
form of her test [3]. 

The reliability of the present test was com- 
puted by the split-half method, i.e., by dividing 
each person's answer sheets into two groups on 
an odd-even basis and correlating the total 
scores for each of the two groups. The nine 
sheets made two groups of five each, the even- 
numbered sheets being supplemented by one 
sheet selected at random from the “odd” 
group. The correlations obtained were .69 for 
the empathy portion of test and .73 for the 
insight portion (N = 87). 

Dymond had also reported that the Wech- 
sler full scale IQ of “good empathizers” was 
132.1 and that of “poor empathizers” was 
126.4, a difference which she described as not 
significant [4]. Inasmuch as she did not re- 
port correlations between Wechsler and em- 
pathy scores, it was difficult to make compari- 
sons. Nevertheless, correlations were computed 
for 75 students between scores received on the 
revised form of the Dymond test and the 
American Council on Education’s Psychologi- 
cal Test for College Freshmen, with the fol- 
lowing results: correlation between “empathy” 
and the ACE (L), -14; between “empathy” 
and ACE (Q), 17; between “empathy” and 
ACE (Total), .14;5 and between “insight” and 
ACE (Total), .02. These results confirm 
Dymond’s interpretations. 

‘An investigation was also made of the re- 
lationship between the individual’s rating of 
his own empathy and the score he received on 
the empathy portion of the revised Dymond 
test. The correlation obtained for 48 individu- 
als was —.04. 

Another investigation was made of 45 stu- 
dents who had taken the Minnesota Multi- 
phasic Personality Inventory as well as the re- 
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vised form of the Dymond test. Although the 
relationship between empathy scores and scores 
received on the various MMPI scales was not 
thoroughly investigated, it was noted that a 
group consisting*of the “poorest empathizers” 
received consistently higher (i.e., more ‘“mal- 
adjusted”) scores on the MMPI, than did a 
group consisting of the “best empathizers.” 
These results are presented in Table 1. They 
tend to confirm the general nature of Dy- 
mond’s findings that persons with “Door” em- 
pathy are not as well adjusted, according to 
personality tests, as are persons with “good” 
empathy [4]. 


Table 1 
MMPI Scores* of “Good” and “Poor” Empathizers 
MMPI “Good” “Poor” 
Scales Empathizers Empathizers 
L 45 48 
F 52 65 
K. 53 48 
Hs 46 51 
i 56 60 
Hy 52 56 
Pd 57 67 
Pa 62 74 
R. 54 64 
Se 57 67 
Ma 60 66 
Number? 7 5 


* Mean standard 
where appropriate, 
t Out of a total of 45 freshmen. 


scores, including “K-correetion™ 


The Effect of Cultural Stereotypes 


In scoring the revised form of the Dymond 
test, the authors of this study became aware 
of the fact that responses to each item did not 
distribute themselves evenly with regard to the 
five points on each scale. There was a definite 
tendency for one of the positions in the scale 
to be preferred with regard to each item. For 
example, with regard to the item on friendli- 
ness (“How friendly or unfriendly do you 
think you are to him or her?”), there was a 
decided tendency to check the fourth item 
(“fairly friendly”). This observation gave rise 
to the hypothesis that perhaps respondents 
were actually not empathizing at all, but were, 


In: effect, responding to a cultural norm or 


Stereotype which says that people ought to 


maintain attitudes which are “fairly friendly.” 
To carry this hypothesis further, it is implied 
that individuals in our middle-class culture 
would be under some pressure either to behave 
in ways which are “fairly friendly” or to be- 
lieve that they are “fairly friendly,” i.e., to con- 
ceive of themselves as “fairly friendly” even if 
this were not actually characteristic of their be- 
havior. “Friendliness” occupies a fairly centra 
position in the values of our culture; we bav 
a high stake in conforming to the milia 
norms; and each of the personal qualities whic 
form the bases of the items in the question- 
naire likewise occupies a central position wit? 
regard to the norms and values of our culture. 
When this hypothesis was checked with m 
gard to responses indicated on the aa 
sheets, a rather decided pattern emerged. a 
cording to the patterning of the responses “a 
the first section, we are likely to think of tact 
selves as “fairly self-assured” in our relatio 
with others; we are “about half and Mes i; 
leaders and followers” ; we are “fairly et 
ly”; we are “neither more nor less intelligi E 
we are “fairly sympathetic” ; we are “fair T 
laxed.” Furthermore, a similar sort of ee 
ing persisted throughout the remaining t 
sections of the questionnaire. , and 
On the basis of this analysis, a male key ie 
a female key were constructed based On “a 
sponses of 100 students, equally rit on 
sex.’ Tests were then rescored in two di os 
ways. They were scored by the keys: . ien 
cording to the original scoring pete tay 
an “empathy” score was obtained by ™ ations 
ing the amount of deviation between Sec 
ITI and IV of the subject’s questionn 
Sections I and II of the key, an 
was measured by comparing Section ¢ the 
subject's questionnaires with Section was 
key. 2. The second method of ee al o 
measure the deviation between each a corr 
the subject’s questionnaires and mého o 


ponding section of the key. This 
sonnaires 4 

2 To save printing costs, the question the 
sheet, and keys have heen deposited ¥ Docume’. yte 
can Documentation Institute. Order don Lea 
3916 from the American Dacron aon a 
Auxiliary Publications, yee a 25, D- ‘high 
c/o Library of Congress, Washing! Š inch 
mitting $1.25 for microfilm (images p) of 
on standard 35 mm. motion Pie iral aid. 
for photostat readable without oP 
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Scoring produced a score which represented the 
tendency of an individual to conform to the 
norm in his responses. 
Pe, ho first method of scoring, the cor- 
a etween the original empathy scores 
T the “normative” empathy scores was .74. 
i correlation for insight was .60. 
ea Sonata method the correlation be- 
nre mieia empathy scores and the total 
fisiche Sa was .56. The correlation with 
scores was .51. 


Discussion 
ined $m of this investigation indicate 
ment ae : 'ymond approach to the measure- 
E wo ER and empathy can be adapted 
i rns e administration, but the reliability 
useful ine low for the test to be considered 
liability « neme device. However, re- 
actory hide probably be increased to a satis- 
dividunle 3 by increasing the number of in- 
self, On ae whom the subject rates him- 
troduces ie other hand, such a procedure in- 
Manner pre complications. The present 
more ahas administration requires somewhat 
minute le a two-hour period, or three fifty- 
cult to Se periods. Furthermore, it is diffi- 
for the ame the interest of subjects even 
other en eee required. On the 
a selectior , if the test were actually used as 
volvement instrument, presumably the ego-in- 
to maintai ie Participants would be sufficient 
minis ain interest even if the number of ad- 

oe were doubled. 
it phonies of the test is in graver question. 
nition ee insight according to the defi- 
too narr ected by Dymond, it probably covers 
Mean b Ow an aspect of what psychologists 
which 7 siehe What we need here is a term 
Seen þh leans the tendency to see oneself as 
measure others,” since this is what the test 

S: 

ane her data are needed as to the extent to 
research e test measures empathy. Dymond’s 
indicat as well as that of the present study 
ts Bi Her that empathy as measured by this test 
‘tdi ably related to personal adjustment as 
Ghar i ed by a variety of measures. However, 
acce bi age 4 is an evaluation based on more 
iy le criteria of empathy. The content- 
interview method of measuring empathy 


175 


developed by Claire Wright Thompson and 
Katherine Bradway suggests itself as a possible 
criterion [2]. 

The gravest question with regard to validity 
grows from the relationship“ demonstrated in 
this study between the “normative” scores and 
scores produced by the method developed by 
Dymond. This relationship comes close to the 
reliability of the test. In other words, the test 
correlates almost as well with the cultural 
norm as it does with itself. This raises the 
question of what an individual does who com- 
pares himself with others by the Dymond 
method. Is he responding to his awareness of 
others, or is he comparing his self concept with 
some cultural norm, or is he reacting to some 
stereotyped concept of how people ought to feel 
and act? Or is he reacting defensively because 
the nature of the questions arouses anxiety? 

Furthermore, one should not overlook the 
possibility suggested by Hastorf and Bender 
that “part of the successful prediction of an- 
other person’s responses may be due to pro- 
jection rather than empathy. ...” [5, p. 576]. 
This hypothesis could account for the high 
correlation between empathy scores and norm- 
ative scores reported in the present study. It 
may be, therefore, that persons show up as 
“good empathizers” on this test if they are con- 
ventional folk who conform rather closely to 
cultural norms and standards and who tend to 
perceive the behavior and attitudes of others 
in the light of these same norms. In other 
words, conventional people get good scores on 
empathy tests because most of their partners 
(or referents) in the test are also conventional. 
Hence the prediction of conventional attitudes 
coincides with the existence of conventional 
attitudes. This would also mean that uncon- 
ventional people would tend to get poor em- 
pathy scores (because they would project devi- 
ating attitudes). Thus when Dymond states 
that “on the whole it is easier to predict the 
responses of a person who is highly empathic” 
[4, p- 345] as measured by this test, she may 
be reporting the discovery that the more con- 
ventional an individual is, the easier it is to 
predict his responses. 

It is quite possible that all these factors op- 
am = bony further research with in- 
ruments of this 4 
consideration the ale Rs Ia 

ms ana stereo- 
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types on the results of the test.* Perhaps the 
empathy of an individual can be measured by 
scoring his questionnaires by both the norma- 
tive key and by the Dymond method. Using 
this approach, ar? individual who has a “good” 
(i.e, low) score on the empathy portion of 
the test, but who has a high score (showing 
marked deviation) from the normative key 
would be a person with much empathy, little 
influenced by the cultural norm. However, it 
would be difficult to demonstrate whether a 
person who receives a low score on each of 
these scorings actually lacks empathy. Perhaps 
what is needed,rather, is a test constructed on 
the same model, consisting of items which are 
less ego-involved, which do not evoke defen- 
siveness or references to cultural norms. How- 
ever, the construction of such a test would not 
be easy, as any item involving interpersonal re- 
lationships would be likely to incur some anxi- 
ety and hence some defensiveness. Neverthe- 
less, such a test would have great value as a 
selection instrument for occupations in which 
empathy is important. Thus it is hoped that 
additional research will produce an instrument 
which is valid and reliable for this purpose. 


Summary 


A minor revision of the method used by 
Rosalind Dymond in the measurement of in- 
sight and empathy was used in an attempt to 
produce an instrument which could be used 
for purposes of selection. Dymond’s findings 
were confirmed that the relationship between 
the factors measured by her test and scores 
received on intellective measures was slight. 
Also confirmed were her findings that persons 


5In a letter to the senior author, Dymond states 
that she has developed a partial-correlation method 
which partials out the stereotype from predictions, 
thus leaving a residual which may have more val- 
idity as a measure of empathy. 


of high empathy have “better” scores on per- 
sonality tests than do persons of low empathy. 
However, the correlation between repeated ad- 
ministrations of the revised questionnaire 1N- 
dicated reliability of the method is too low for 
predictive purposes, although it probably 
would be improved if the total number of ad- 
ministrations were increased. 

However, the validity of the method is ques- 
tioned in view of the high degree of relation- 
ship between scores received on the revised test 
and those produced by scoring with a normé 
tive key. The correlation between these scores 
is almost as high as the reliability of the i 
This raises the question of whether the tes 
measures the tendency of individuals to re 
spond to an interpersonal situation in terms 
of cultural norms rather than empathic 
promptings. It was suggested that both fac 
tors may operate. Yet until they can e 
measured separately, or until a form of the se 
is developed which does not evoke ean 
to such norms, the use of the present revis! 7 
as a predictive measure of insight or empat 
appears inadvisable. 
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oe persons nondirective play therapy 
and sath rou to learn, pleasant to undertake, 
tion nt ying in results. Much of the atten- 
its = nea to play therapy has resulted from 
that ie ent ease as well as from the concept 
of the child ne natural medium of expression 
as the m Ry Play has come to be recognized 
the nrk setis ROn way of understanding 
widespre a al child. Because of the current 
tfainis a e in child psychology, child 
years “a education, and mental hygiene, recent 
activit ave seen a great deal of concomitant 
the a in nondirective play therapy. Much of 
audire ac, has resulted in emotional articles 
cles ee play therapy. These arti- 
tive pla th y explain the efficacy of nondirec- 
cotstricts erapy on the basis of philosophical 
eveloped ot from the growth principle 
adults, rom nondirective counseling with 
is oan in nondirective therapy with adults 
tive pla eo extensive. Research in nondirec- 
unsound therapy with children is still meager, 
sive natu and frequently of a cheerful, persua- 
that eh It has seemed to the present writer 
ified as articles could be more correctly class- 

Propaganda than as research. 
eae paper is an attempt to review 
ith oe in nondirective play therapy- 
than tie ia ccs’ studies involving more 
report gi child have been reported here. The 
avoided o> only a single case history has been 
Nondire: Also, only studies concerned with 
is no d = play therapy are reported. There 
istor A es that play therapy has a considerable 
Stee t may be said to extend back to 
child i [23] who studied the play of the 
nondire understand his psychology. However, 
work Re play therapy developed from the 
Carl Rogers [21, 22] and his associ- 


ates. One of them, Virginia Axline [2], was 
the first successfully to apply nondirective 
methods to play therapy with children. Ax- 
line’s book, while widely read, is more sug- 
gestive than it is factual. It seems to have been 
the forerunner of much of the persuasive ma- 
terial to be found in studies of nondirective 
play therapy. 

A recent example of the continuing propa- 
gandistic tendencies in nondirective play-thera- 
py research papers is to be seen in an article 
titled: “An Experiment in Play Therapy” 
[11]. The stated purpose was to help children 
who seemed unable to adjust to the school situ- 
ation. The children were selected on the basis 
of Rorschach tests, their teacher’s impression, 
and the therapist’s observations. Two groups 
of five children each were selected for non- 
directive play therapy- The majority of child- 
ren selected had problems of sibling rivalry. 
The groups met once a week for play therapy. 
Much verbatim material from the therapy 
notes was presented to enable the reader to 
partake of the emotional flavor of the situation. 

The shortcomings of the “experiment” are 
serious. First, it lacks a clear hypothesis and 
a control group. Second, the results seem to 
indicate a lack of rigorous method. For it is 
the conclusion of the research that “through 
group work they [the children] learned that 
they were not alone in having ‘bad feelings.’ 
Other children had them too” [11, p. 180]. 
Further that “. . . their natural healthy drive 
toward maturity, which had been retarded, 
could once more assert itself” [11, p. 180]. 
Such conclusions would seem to savor more of 
a desire to support nondirective play therapy 
than they do of experimental procedure. 

W hat takes place in nondirective play thera- 
py? With the philosophy of the love of zhild- 
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ren, and the idyllic purposefulness of many of 
the typical articles stripped off, nondirective 
play therapy seems to be left a rather thin 
framework. A determination of the process of 
play therapy, as ‘contrasted with the results of 
play therapy, has been subject matter for only 
three known research studies. 

The first such study was the work of Land- 
isberg and Snyder [18]. They attempted to 
analyze what actually took place in client- 
centered play therapy by an objective approach. 

heir procedure was to study the protocols of 
three successful and one incomplete case. Each 
statement made by the counselor was cate- 
gorized as to its content. Statements made by 
the children were categorized as to content, 
emotion expressed, and activity. Although the 
children ranged in age from five to six years, 
the categories used had been developed for em- 
ployment with adult cases, 

They reported finding an increase in the 
child’s physical activity during the last three- 
fifths of therapy. The children were found to 
have released much feeling during therapy. 
About 50 per cent of their actions and state- 
ments during the first two-fifths of treatment 
were devoted to emotional release. This per- 
centage rose to 70 for the last three-fifths of 
the process. It was noticed that negative feel- 
ings particularly increased in frequency. The 
major part of the children’s feelings were di- 
rected towards others and not to themselves 
or to the counselor. No insightful statements 
were made by the children whose records were 

studied. 


Finke [15] did not use adult categories in 
analyzing children’s nondirective play therapy 
Protocols, but derived her categories from an 
analysis of children’s statements. Expressions 
of feeling were emphasized as it was believed 
such expression would mirror the child’s 
changing emotional reactions resulting from 
the play therapy. 


She selected complete protocols from six 
play therapists concerning six different children 
referred for behavior problems. The children 
ranged in age from five to eleven years. The 
Possibility of bias resulting from one person’s 
categorizing all the cases was avoided by hav- 
ing five students recategorize one or more in- 
terviews chosen at random. Their results 
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corresponded adequately with the original cate- 
gorization. S ; , 

It was found that different children, mae 
going therapy with different therapists, e 
similar trends which tended to divide pia 
therapy into three stages: 


1. Child is either reticent or extremely talkative 
He explores the playroom, If he is to show api 
sion at any time during therapy, a great deal © 
wiil be exhibited in this stage. g 

2. If aggression has been shown; i the play- 
lessened. This child tests the limitations 0 i 
room. Imaginative play is frequently indulged 
rom of the child’s efforts are now expended 
inte attempted relationship with counselor. 
child tries to draw the therapist into his game 
play. 

Like Landisberg and Snyder [18 
[15] found no trends for positive state! 
Unlike them, she found no trends for ne ii 
statements. The verbal characteristics of eat 
counseling sessions did not appear. van | its 
cluded that nondirective play therapy iat 
own characteristic pattern which was rep“ 
in case after case. ' i- 

Both studies indicated that children e "e 
tudes changed during therapy and — i 
changes could be quantitatively repo th 
There seem to be serious limitations < ult 
studies. Landisberg and Snyder use¢ * She 
categories. Finke found fault with this 507 
indicated that differences in the age ‘hildren 
phistication of the adults and th ; 
would affect the degree and type oni 
tion made. Consequently, she felt 1t Y nts 
justifiable to evaluate children’s oe e 
the basis of categories derived from 4 nize 

Finke seemed to have failed to recoBt i screP” 
possibility that just as the wide 48° ight in- 
ancies between adults and children, ation, se 
fluence the character of their verbaliza tl 


ifican 
might children’s categories 


is now 


s an 
J, Finke 


ments: 
gative 


i 
vary sign! 


from one level of maturity to another, rudy 
The present writer [19] under wE, 
of the possible relationship between ts made 'i 
cal age and the types of statemen ad Finke 
children in play therapy. He u 
[15] categories. jay-thert Y 
Twenty children were given Ae e rio 
sessions by the same therapist 1n equated for ges 
room. The children were reasonably jve abe £ 


: : t 
telligence and social adjustmen 


Research on Nondirective Play Therapy 


aoe a with two boys and two girls in 
are ge. Children were selected who were 4, 4, 
A and 12 years of age. 
ed rai PRS of verbatim style notes were select- 
ee Ge table of random numbers from the 166 
a A een These 15 pages were then cate- 
Bércenta 2 ee experienced play therapists. ‘Their 
Sie sae of agreement were adequately similar to 
azed b Ki All of the protocols were then an- 
Tt y the writer. 
dente. that maturation, as represented by 
finite aa age, did seem to account for some 
children in ie in the types of statements made by 
As the aia play-therapy situation. 
bist: fewer A ren became older, they told the thera- 
ii E rae decisions. They spent less time 
tetapts. to | the limitations, They made fewer at- 
they raw the therapist into their play and 
expressed more of their likes and dislikes. 


corte tiirsa studies, while not strictly com- 
tive ole Ww = seem to indicate that nondirec- 
Prazer y i erapy isan objectively measurable 
aie te ys children s emotional expressions 
maturati in a discernible manner; and that 
Ekmen, appears to be related to the type of 
Si a n of therapeutic change. Beyond such 
Philo nts the studies substantiate few of the 
sophical aspects of play therapy- 


The Successfulness of Nondirective 

T Play Therapy 
‘ties aa aR of play therapy in various 
een us h ases. Nondirective play therapy has 
Seemin 1 in the study and treatment of such 
linen y diverse problems as allergy, mental 
andi Ney, personality problems, physically 
ing Fin hema race conflicts, and read- 
one a culties. From the published reports 
een Ceives the impression that it has usually 
chil yo o successful or incomplete. The 
ing sy. n are seemingly relieved of their present- 
tenis mptoms or the therapy is unavoidably in- 
ae in a promising but unfinished phase. 
of ee play therapy in the treatment 
a suc TEY: Miller and Baruch [20] following 
gee u preliminary psychotherapeutic 
childr ent of allergy [8] undertook to treat Six 
thera en under eleven years of age by play 
sym by. All their subjects had classical allergic 
to oe confirmed by positive skin reactions 
t — allegens. Prior to nondirective play 
tre apy all the subjects had been unsuccessfully 

ated medically. 

hey cite as a representative case a five-year- 
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old asthmatic boy who used attacks of asthma 
to gain contact with his mother. Whenever 
she left him, the asthma would express his hos- 
tile feelings. His asthmatic attacks cleared af- 
ter five months of play therapy. Unfortunate- 
ly, for purpose of this investigation, 16 allergic 
adults were included in the results. As a re- 
sult, it can only be said that of the 22 patients 
(including the six children), 21 showed im- 
provement while one was unchanged. 
Nondirective play therapy in the study of 
mental deficiency. Exploratory material sug- 
gestive of the emotional factors in mental de- 
ficiency is presented by Axline [5]. In a re- 
port of an examination of selected play-therapy 
protocols, evidence is offered which indicates 


marked improvement in some IQ scores after 
completing play therapy. 

The verbatim stenographic reports of 15 six- 
and-seven-year-old children referred for be- 
havior problems were studied. Each child had 
been seen individually by the same therapist 
for 8 to 20 contacts. The reports were selected 
and analyzed at some time after therapy on the 
basis of Stanford-Binet 1Q ratings and the age 
of the children. The records were then 
grouped as follows: 

1. Children who showed no appreciable change 
in IQ scores after therapy. Pre- and posttesting 
indicated low intelligence. 

2. Children who showed a gain in IQ scores af- 
ter therapy. Pretests were low; posttests were in- 
dicative of normal intelligence. 

3. Children with average intellig_..ce both before 
and after play therapy. Children from this group 
had play therapy in a children’s home. 


In every case of those children whose IQ 
stayed low, their mother had indicated shame, 
disapproval, and rejection. It was felt that the 


children’s difficulty lay in their daily lives. 
“They were not able to communicate clearly 
to others the things that were uppermost in 
their lives” [5, p- 528]. The therapist felt that 
each of the cases in the first category was in- 
complete. However, it was impossible to finish 
therapy. 

In the case material presented, it is evident 
that both the children whose IQ’s did not im- 
prove and those whose IQ’s became normal in- 
itiated play activity. Both groups freely ex- 
pressed negative feelings and destructive pla 
which was followed by outgoing ari E 
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positive behavior. The only difference would 
seem to be that the children whose IQ’s were 
raised had completed their therapy. : 

The same behavior was shown by the child- 
ren of average intelligence whose IQ’s did not 
change. This group was included to indicate 
that mental deficiency was not the cause of be- 
havior problems for these children. 

Axline [5] did not claim that nondirective 
play therapy raised the IQ of the children of 
group two. She explained the increase in IQ 
scores by saying the child was freed from 

emotional constraint and could thus more ade- 
quately express his true capacities. 

Nondirective play therapy in the treatment 
of personality disorders. While most of the 
work in play therapy has been done in the area 
of personality, there is a dearth of research ma- 
terial. This can be explained by the client- 
centered philosophy from which nondirective 
play therapy sprung. Play therapy is oriented 
around the needs of the client and not around 
the demands of research. For this reason there 
are “cases” offered to prove that play therapy 
works, but there are still few research studies 
undertaken to see how well it works. Bloom- 
berg’s [11] work, already discussed, represents 
the research aspects of proselytizing for play 
therapy. Instead of presenting one case, she 
presents ten. But she presents these ten cases 
in a manner in keeping with the philosophy of 
nondirective play therapy. That is to say, the 
experiment was not designed to stimulate re- 
search, it was designed to help children. Con- 
sequently, her material merely indicates that 
play therapy works — a fact which no one dis- 
putes. 

An experiment that deserves to be a model 
for future play therapy work is available in 
this area. Fleming and Snyder [16] en- 
deavored to determine if measurable changes 
In social and personal adjustment resulted from 
nondirective play therapy. 


They had three simple personality tests adminis- 
tered to 46 children. Seven children who ranged in 
age from eight to eleven years were selected for 
play therapy on the basis of poor results in these 
tests. After a lapse of 12 weeks, 30 of the 46 
children were available for retesting. 

Fleming and Snyder [16] found the three girls 
had improved their adjustment with a greater 
amvunt of positive feelings. The least amount of 
*Mprovement for the girls was in the social area. 
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Save for one individual who fared worse, the or 
boys made no significant changes. The rama 
group posttest score was the same as their pre 
score. ae 
From an analysis of the group scores as we 
from individual data, they concluded the ane : 
change for the subjects was in personal age = 
toward the self and in daydreaming. peat <a 
theory is offered that personal changes in nel 
ment must precede social change. The therapy ka 
perience had created more positive aeons 
the subjects but it did not cause the contro! & 
to like them any better. 


Since this was the first study of its kind, a 
was to be expected that certain of their Lie 
should contradict some of Axline’s [2] wee 
observations. Although Fleming and Sny a 
did not indicate it, the following contradictio 
of Axline’s observations were suggested: 


factor in 
Id boys 
Ax- 


1. The therapist's sex was an important 
establishing rapport. They found tenyen 
would not respond well to a female henti plat 
line had said, “Nor does the sex of the inet, 
seem to be important [for successful play thers 
2, p. 65]. apy 
ow _—e who was not given fags 
prevented successful therapy with the boys p not 
Previously, Axline had stressed that, It dër to 
necessary for the adults to be helped in s 
insure successful play-therapy results” a" P' achiev" 

3. The best therapeutic results seem to ae same 
ed when the children in the group have api 
degree of maladjustment. Axline had said, Ko kai 
ments in groupings indicate that there ae vg have 
rules to govern them: Successful groupir e range 
included both sexes, siblings, and wide "8° ved, 
es” [3, Pp. 269-270]. In another place À grou 
“A handicapped child can be treated 1N 
with normal children” [3, p. 27]. 


a 


vant 
yan 
š o wat 
Axline’s statements would seem t! 


additional experimental investigation. 
Nondirective play therapy in the x 
of children with physical handicol 
[2] included cases of handicappe Gaid 
o 

[12, 13] undertook the only other kn 
n 

term! } 
pe theraP 
ndicapP 


set themselves the problem of 
whether or not nondirective group z A 
could be applied to physically ” 
children, ndi- 


They held 13 meetings y ith wen 
capped children all of whom i 
emotional problem. The children’s 
parents made an essay-type report 


rs 
teache child’s 
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= at the start of the program. At the last 
ag similar reports were filled out again. 
via s by nia account: the authors recount the 
tandi 6 a. ony eae child, This boy would pre- 
bleed to de T therapist’s fingers to cause him to 
ii alas SEATED, The imaginary blood was collected 
Ys da placed around the therapist. 
ees a found three of the children 
ae tas onsiderable observed improvement in both 
reported’ ane the school. One child made slight 
They R a and one showed no improvement. 
offers oe ‘Gh ed that “the nondirective play-group 
sie ed id eal setting for the self-solution for a 
those ten type of emotional problem; namely, 
physi is a ming from the specific disability of the 
ysically handicapped child” [13, p. 214]. 


Wi investigators themselves realize their 
h as been conducted at a very gross level. 
cai a out several weaknesses of the 
of quai k mong these weaknesses are the lack 
ani m E material. There were no pre- 
up Stud therapy tests. There was no follow- 
ternpor y to see if the indicated gains were 
nmi S or cyclical in nature. Nor was a 

group utilized to demonstrate more 


clearly Res oe: 
carly that the play situation was the critical 
factor, 7 


mi: recognition of such lacks is a healthy 
of in t suggests an awareness of the possibility 
the nproving future research work in play 
tapy by more rigorous procedure. 
rac ondirective piay therapy in the handling of 
4 7 conflicts. The effectiveness of play thera- 
ta small groups of children who had diffi- 
sy adjusting to other children was the pri- 
“Play purpose of an investigation by Axline, 
Child Therapy and Race Conflict in Young 
o ren” [3]. She selected four groups of 
ur children, two boys and two girls, who 


we i 5 . 
Te either withdrawn or aggressively anti- 
Social, 


Aft group met once a week for ten meetings. 
‘or foe tenth meeting the children were mixed 
Tih additional meetings. Axline [3] found iar 
a st were accepted by the group after t e 
Over į meeting. This new acceptance was carrie 
a fence the classroom. In all groups, “There was 
with ency to participate in the group meetings 
309_ an awareness of the rights of others” [3, PP- 

7310]. The race problem was never an issue 
uring the five mixed meetings- 


2 his study is more provocative than it is 
me initive. The children selected were anti- 
cial and not racially bigoted. It is quite pos- 


sible that the figure of an habitual intergroup 
improvement in social relations was dressed in 
the false whiskers of lessening social antago- 
nism. In that case Axline has given an old 
phenomenon a new name. , 

Nondirective play therapy in the treatment 
of reading disabilities. Since reading difficulty 
is frequently associated with emotional dis- 
turbances, it is not unexpected to find several 
research articles on the effectiveness of a thera- 
peutic approach designed to relax and better 
adjust children who are retarded readers. 


Axline [1] reported a study of 50 second-graders, 
listed as poor readers by their teachers, who were 
given a reading test. The 37 who received the low- 
est scores were placed in a special class. At the 
end of the semester, three and a half months later, 
intelligence and reading tests were administered. 

There were 8 girls and 29 boys in the groups 
with Stanford-Binet IQ’s ranging from 80-148. Un- 
like most remedial reading classes, these children 
had all their school work in one room with the 
same teacher. The reading problems were consid- 
ered to be part of the whole child. “The children 
came first. The reading, writing, and arithmetic 
came secondly” [1, p. 65]. The children were given 
the opportunity for ample emotional expression. In 
accordance with the techniques of nondirective play 
therapy their feelings and attitudes were not only 
accepted but were also clarified. No remedial read- 
ing instruction per se was given. 

Axline [1] found that 21 children gained more 
than the maturationally expected 3.5 in words. In 
the case of four subjects there was a noteworthy 
he first and second IQ score. One 


difference in t 
subject’s score was increased from 83 to 119. 


This study would seem to indicate that non- 
directive therapeutic procedures are effective in 
building up a readiness to read in children. 

In a later and briefer report Axline [6] 
studied three problem readers. Interestingly 
enough, only two of the children were poor 
readers, while the third child read too much. 
This child used books as a substitute for 
friends. All the children were above average 
in intelligence. 

It was found that the feelings expressed in 
play brought out emotional problems that could 
easily account for the reading difficulties. Ax- 
line concluded, “Giver the opportunity the 
child can and does help himself” [6, p. 161]. 

Neither of Axline’s [1, 6] reports included 
experimental controls. Bills [9], working with 
22 slow learners in the third grade utilized 
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three 30-day periods of study. The first period 
was a control period in which all the children 
were tested with oral reading, silent reading, 
and Stanford-Binet tests. At the end of that 
period all the children were retested. They 
were also retested at the end of the second and 
third periods. 


The second period was the therapy period. The 
four children with the largest discrepancy between 
mental age and reading age were given nondirec- 
tive play therapy. These children all had high IQ’s. 
Four other children were selected whose IQ’s were 
approximately average. 

The third period was used as a follow-up period 
in which the children were tested again. 

During the experiment, reading instruction was 
not remedial in nature and it was kept constant for 
all members of the class. Thus, a single group was 
compared with itself for three 30-day periods. Each 
child was his own control as the three periods were 
comparable in regard to reading experiences. 

The therapy group made a significantly greater 
gain in the therapy period than it did in the control 
period. The gains of the therapy group during both 
the second and third periods of the study were sig- 
nificantly greater than the gains during the first 
period of study. 

The gains in reading ability appeared immedi- 
ately after therapy for some children and after a 
short period following therapy for others. The 
gains were found to be present six weeks (30 
school days) after therapy had ended. 

Three judges agreed that five of the children had 
gained in emotional adjustment following play 
therapy. However, the design of the study did not 
Permit conclusions as to the effect of maladjust- 
ment on children’s reading ability. 


To answer the question as to whether im- 
Proved reading ability was due to improved 
personal adjustment Bills [10] conducted play 
therapy with well-adjusted readers. The de- 
sign of the second study was similar to that 
of the first save that children were now select- 
ed for good adjustment by projective and ob- 
Jective personality tests. 

He found reading gains were not signifi- 
cantly greater during the therapy period. So, 
It would appear that nondirective play therapy 
may improve reading in those children where 
emotional adjustment exists with the retarda- 
tion. Consequently, play therapy is not neces- 
sarily the method of choice for all retarded 
readers as the reports of Axline [1, 6] might 
suggest, 


Follow-up studies of nondirective play thera- 
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py. While it seems to have been demonstrated 
that play therapy is productive of personality 
improvement, it has not been shown whether 
the effects of therapy are permanent or tempo- 
rary. Consequently, the value of follow-up 
studies cannot be denied. . ‘lit 

Bills [9] found improved reading abi rif 
present six weeks after therapy. Axline ( : 
reports on an interesting study of a boy ier 
1Q was 65; upon retest it was 68. Six mont T 
after play therapy his IQ was 96. A year late 
it had gone up to 105. Part of this gain miey 
be ascribed to test familiarization. H 
the lasting effects of play therapy are 48° 
suggested. = 

in a long-range follow-up, Axline (7) 
lected 30 successful play-therapy case ee 
Of these, 22 subjects were available for fol m 
up study. Nineteen of the subjects were e 
successfully adjusted a year later, two Tonë 
successfully adjusted three years later, e 
five years after the original contacts. A fo ious 
up of 24 of the 37 children used in prev 
research [1] was made five years latet sett 
this group originally designated as poor ee 
five were honor-roll students and four pies 
had reading skills adequate for their & 
placement. Id seem 

The effects of play therapy then wou {f per 
to be lasting, particularly in the area © 
sonality adjustment. 


Summary and Critique 


Soy direc 
The principles and methods of non ie 


play therapy are frequently Pree rhe as 
though they were firmly established. he at” 
sured manner of writing of many ° held be 
thors and the large-scale possibilities ve that, 
fore the reader, tend to make one bel! ctu” 
at long last, “the way” has been popne e the 
ally, this is not so. Indeed, it may oe e, that 
specific procedures of play therapy» Pr sonality 
effect the rather remarkable Ping from 
changes. The children may be ben setently 
having someone constantly and gors e 

terested in their welfare. Those W Iving |h 
ence in hospitals and institutions ! 1 

mentally ill have noticed the un“ 


tive 


ing any ne the 
percentage of cures ae jt is n ye 
ment. They have reported 5 die | ii 
treatment method that ei interes 


ment, rather it is the increase 
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in the patient. So, too, may it be with non- 
directive play therapy. 
ieee [2] presented no experimental evi- 
pies pr te the worth of play therapy. A 
tw OE, DoE literature reveals fewer than 
Palo published articles on the therapeutic 
a play therapy. To be admitted to the 
paar “piron therapeutic methods non- 
thusiasm Pel shoroy needs more than en- 
if Jna n 5 icf, and the shibboleth, “It works, 
5 nly try it. 
tee irent weakness of nondirective play 
the rel ise this impetuous overlooking of 
most a i fora foundation in research. The 
Sine. ene need is for the employment of 
ment a se ay therapy. The personal adjust- 
before Bee equated groups should be assessed 
should i The children in the group 
mental heat e randomly assigned to experi- 
of Asie control groups. Upon termination 
o be! all the children should be retested 
the play te the quantitative effectiveness of 
ren ne terapy technique in “helping child- 
ain maturity.” 
pine play therapy, while promising 
ave ec subjectively, has been seen to 
cannot a serious methodological lacks. One 
work yoana with Kanner [17] tha: play 
Stages, “h children, while still in its beginning 
as been nas come to stay,” until play therapy 
ong ry established by objective means. In the 
stand don nondirective play therapy should 
Studies į all on the results of experimental 
to othe Nvestigating its effectiveness 1n relation 
r procedures. 
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The Relative Effectiveness of Larger Units Used 
i in Interview Analysis’ 


John E. Muthard 


Ohio State University? 


This study investigated the relative effective- 
ness for studying client and counselor inter- 
action of several larger units used in the analy- 
sis of transcribed interviews. This basic meth- 
odological question needs to be resolved ‘so that 
future interview research can use the optimum 
unit, and so that findings from different studies 
can be compared and integrated. In addition, 
the study was concerned with the extent to 
which the units studied enable one to deter- 
mine whether the different roles assumed by 
the client and counselor during an interview 
affect their respective behavior. 

Protocol research has used a wide range of 
units to group client and counselor statements 
for the purpose of analysis. Early investi- 
gators in this area were principally concerned 
with studying single speech units, e.g., single 
remark and idea units. More recently, re- 
searchers have become more concerned with 
client and counselor behaviors in larger seg- 
ments of the interview. The larger units used 
have been: the whole interview, discussion 
topics, and fractions of the interview or inter- 
view series [4, 5]. Larger units have several 
advantages over single speeches. They (a) 
have been found to be more reliably rated, (4) 
Permit the study of meaningful structures in 
the interview which would otherwise be ig- 
nored, and (c) permit the study of delayed 
effects of both client and counselor responses 
on the Progress of the interview. Comparing 
and integrating the findings arising from such 
a multiplicity of units is very difficult. 


Procedures 


Interview sample. To permit the widest 
1 Supported in Part from funds granted to the 


io State University by the Research Foundation 
or aid in fundamental research. 


ow at Emory University, ° 


inter- 


ssible alization from this study, 
possible generalization only 


views were selected which represent not lif- 
different counselors, different clients, <n 
ferent type problems, but also different inst! ly 
tions. Heretofore, cach researcher has sn 
used protocols obtained in his own inna 
As may be surmised, different counse 5 
centers ‘attract different types of clients i 
problems and also often vary in the a 
counseling approach used. Thirty-six coal 
were selected from a pool of 267 ee 
typescripts prepared from electrically re jin 
interviews at four universities: Chicago, scl 
nesota, Missouri, and Ohio State. Ihe tion- 
sample included 12 client-counselor re wat? 
ships. There were three sets of three con® 


S- 
I . e ‘ngtitution! 
tive interviews from each of the da e 
Wherever possible the cases selecte acts, DU 

acts, 


all the interviews in the series of cont he 
when this was not feasible—because ater” 
length of the case—three consecutive 
views were selected from the ease: studied 
Units of the counseling interview hel 
The larger units studied here include 
cussion topic, fraction, and problem 
was thought that the whole interview 
separate study since it has been foun 
a definite pattern of organization. ] the co” 
The discussion topic represents & or abou 
versation of both client and agora 
the same topic or subject. The o é 
for this unit were determined by ters: $ 
judgments of three independent ews inde 
marking the division of the mer ferne? “ 
pendently, the judges met in Character g i 
reconcile any differences. The e Jength 
merit of this unit is discusse f nine i 
Robinson [3]. For a sample © k 
views, two or all three judges z per ce” 
or within the same remark for s 
the discussion-topic division points. 
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f A problem-arca unit consists of all the con- 
tiguous statements dealing with the same kind 
of problem. The initial step in determining 
these units is the same as for discussion topics. 
But ‘since several successive topics may be as- 
Pects of the same type of problem, it is next 
necessary to group together those topics in the 
Pe Class. The unit classification categories 
r 'ggested by Robinson [+] were used, i.e., ad- 
— skill, and special categories, to which 
S added a new class, test interpretation. 
nes hii which the counselor told the client 
‘at the test meant and evoked little client 
L a were placed in this category. In 
relik of interviews used to examine the 
three w of demarcating this unit, two or all 
5 judges agreed within the same remark 
> per cent of the time. 
Pte wit the fraction comprises a definite 
of sey of the total remarks within a series 
counseling interviews. For this research, 
i of each series was the unit used. Some 
sie tigations using this unit are described by 
ae Pt The reliability of determining its 
Dimen srigusly quite high. d 
syne wsions of the counseling process Usei 
the beh p the three types of units studied, 
sidered E within cach unit had to be con- 
ok his was done by selecting dimana 
in ea the following criteria: reliabi ity 
now Ng, representativeness of the dimensions 
used, and frequency of use in research. 
Ne concepts selected for use in this investi- 
pe were two counselor dimensions: amount 
ili cad and counselor assumption of responsi- 
a Ni two client dimensions: client * 
tia d lon of responsibility and working rela- 
aship [2]. Amount of lead refers to the 
hn which a counselor’s remark seems to be 
a bi of the content of the client’s last remark 
ideas i pressure upon the client to adopt new 
E t ounselor assumption of responsibilty 
Concerned with the amount of responsibility 
which the counselor assumes, which he per- 
Mits the client to assume, or which he forces 
: e client to assume. Working relationship re- 
Ers to the degree that there is a mutual respect 
tween the participants and the degree the 
client feels free to present his problems. In 
tating client assumption of responsibility, the 
te considers the extent to which the client, 
ight of what the counselor is permitting 
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him to do, takes an active role in clarifying his 
problem and participates in making plans for 
dealing with it. 

Judging procedures. Persons participating 
in the ratings for this research were advanced 
graduate students in the student personnel pro- 
gram at the Ohio State University or had 
equivalent background or experience. They 
were trained in making whatever judgments 
they participated in. Three judges demarcated 
the units and rated the three global dimen- 
sions. Only two raters judged amount of lead, 
since this remark-by-remark rating can be done 
with high reliability. Precautions were taken 
to avoid introducing systematic variations in 
rating which might favor any of the three units 
studied. 

Hypotheses. Four hypotheses were proposed 
as means of evaluating these units. Two of 
these dealt with reliability. They were: Hy- 
pothesis 1: There is a difference between the 
interrater reliability coefficients obtained for 
the ratings of the three types of units. Hy- 
pothesis 2: The units differ in the degree 
which the first half of each unit correlates with 
the second half. It was further predicted, in 
both instances, that ratings for problem-area 
units would be most reliable and those for 
quintile units would be least reliable. 

The two other hypotheses considered a unit’s 
capacity for distinguishing useful segments of 
the interview. That is, they examined the ex- 
tent to which the units studied make varia- 
tions within the interview discernible. Hy- 
pothesis 3 was: There is a difference between 
the correlations obtained for ratings of two 
halves of a unit and those obtained for ratings 
of the last half of a unit and the contiguous 
half of the next unit. In the case of discus- 
sion-topic and problem-area units it was pre- 
dicted that ratings of within-unit halves would 
correlate to a greater degree than those of be- 
tween-unit halves. Fractions were predicted as 
not showing such a difference. Hypothesis 4 
was: Observable shifts in client and counselor 
behavior from each unit to its next adjacent 
unit differ when the difference scores? of the 
three units under study are compared. It was 
predicted that shifts would be greatest in the 
problem-area unit and least in fractional units, 


3 The numerical difference between mean em 
of adjacent units wıthout regard to sign. gs 


T 
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In each case the hypothesis was stated in the 
null form and tested. 


Results 


The reliability coefficients for the combined 
ratings indicated that the variables could be 
rated consistently enough to permit their use 
in research. For the three diffcrent-type units, 
the median reliability coefficient for the com- 
bined ratings on amount of lead was .93. 
Similarly, the median for counselor assump- 
tion of responsibility was -90, for client as- 
sumption of responsibility .72, and working re- 
lationship .71. Table 1 presents the complete 
reliability data for combined ratings. 


Table 1 
Reliability Coefficients for Combined Ratings 
(Spearman-Brown prophecy formula used to 
take into account combined ratings) 


Discussion Problem 
Dimension topic area Fractions 
Amount of lead 93 -93 96 
Counselor -90 86 94 


assumption of 
responsibility 

Client 42 71 .73 
assumption of 
responsibility 

Working Al 69 77 
relationship 


In terms of reliability, no one of the three 
units was found more advantageous than an- 
other. In only one of the twelve comparisons 
of correlations obtained from combined ratings 
was the obtained difference significant. In this 
instance, fractions were rated more reliably 
than problem-area units on the dimension 
counselor assumption of responsibility. Since 
such a difference might occur by chance dur- 
ing the course of 12 comparisons, the findings 
were interpreted as not Providing sufficient 
evidence to reject the null hypothesis, 

Neither could the hypothesis that the units 
do not differ in the degree which the first half 
of each unit correlates with the second half 
be rejected. The largest critical ratio obtained 
was .96 which failed to meet the fiducial 
limits set. Table 2 presents the correlation co- 
efficients obtained in testing this hypothesis. 

Although these findings concerning reliabili- 
ty do not Support the alteznatives proposed, 
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Table 2 ; 
Correlation Coefficients for Mean Ratings 
of Within-Unit Halves 


Dimensions 


Amount Working 
Type Unit of Lead Relationship 
Problem area 79 a 
Discussion topic 675 8? 
Fractions 72 = 


they are amenable to explanation. Since the 2 
interviews were divided into 60 fractional, h 
problem-area, and 174 discussion-topic ue 
it is apparent that fractions of the intervie k 
were generally three times as long as e 
topics and almost twice as long as problem 
area units. Thus, the reliability for Taung 
fractions was enhanced, since in ears 
measurement, the larger the sample, the highe 
the reliability usually is for judging. iyor 

Another important criterion of thenien se 
ness of an interview unit for studying © i 
and counselor behavior is the degree Ti 
which it makes discernible variation from “ 
unit to another within an interview or ne it 
of interviews, that is, the extent to whic iors 
enables one to observe the variety of behav! 
incorporated within an interview. 001 

Hypothesis 3 can be rejected at the ‘an 
level of confidence for both problem-aret a es 
discussion-topic units on both of the — two 
tested. In the comparisons involving ng alves 
units, the correlations for within-unit “those 
were always significantly greater tan was 
for between-unit halves. However, the tiona 
not a significant difference for the f i 
units studied. These findings are $ 
Tables 3 and 4. 

A test of the sensitivity to vari 
and counselor behavior of the three tY 


Table 3 


Significance of the Differences ae 
of Amount of Lead Ratings for 


rac + 
hown # 


int 
ations 1n clien 
pes ° 


jons 
n Correlatio® 


-Unit 


Halves and Between-Unit Halves 
Correlations Corre a en nite i 
Deen a OE e, 
Discussion topic 147 WS pe aay 
Problem area 81 .79 ne 4.6 
Fractions 48 72 : e-tail test- 


i Tí 
*Significant at the .001 level using © 
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D Table 4 

Significance of the Diference between Correlations 

of Working Relationship Ratings for Within-Unit 
Halves and Between-Unit Halves 


lations Correlations 


Lene Gor 
MRE BAI _ for within- for between- Critical 
Di z N unit halves unit halves ratio 
ti iu topic 147 89 G6 3.34" 
ziela area $1 90 57 sas 
vac k K x 
schon. 48 86 86 0.00 
*Signi = 
Significant at the .001 level of confidence using the 


One-tail test. 


ae Table 5 
Significance of the Difference between Sets 
(ised of Difference Scores 
Sed on analysis by Mann-Whitney U test [1]) 


Unit Comparisons 
Problem area Topic Problem nren 


Di + 
Imension vs. fraction vs. fraction vs. topic 
a % x 
Amount of lead 5.314 4.814 1.50 
‘ounselor 3.414 3.301 .76 
assumption of 
i ponsibility 
S 2.62} 1.48 1.64} 
assumption of 
responsibility 
orking s 
. 2.671 1.81 1.21 
relationship 67+ t 


* Simi 
$ ase to the critical ratio. 
at the 01 2> 1.96 the null hypothesis can be re. 
Swen level of confidence. 
at the 0; an @>1.64 the null hypothesis can be rejected 
+05 level of confidence. 


jected 


ss og was made with hypothesis 4. The re- 
pi : obtained from examination of this hy- 
othesis are shown in Table 5. 7 
ween. all four of the variables used in iiin 
i sae problem-area unit ratings y!e : 
ten a scores which were significantly 
hl t Petter than#he 0l level, than those 
As T for quintiles of the interview series. 
i able 5 indicates, there is & significant 
w erence for three of the dimensions studied 
eae discussion topics and fractional units si 
is pared. However, when problem-area an 
SCussion-topic units were compared, only one 
i erence was barely significant. In general 
en, both problem area and discussion topic 
Produce greater variation from unit to unit 
nee does the use of fractions. We have little 
asis for determining whether the problem area 
of discussion topic is better than the other. It 
> mld be noted, however, that in this com- 
Parison all the differences were in the direc- 
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tion of greater sensitivity for problem-area 
units and that 58 per cent of the difference 
scores for these two sets were identical. 

An analysis of client and counselor behavior 
during the course of a “typical” interview sug- 
gested that one of the factors associated with 
behavior changes between successive problem- 
area or discussion-topic units is changing-role* 
behavior. That is, the variations within the 
conference may be a function of the demands 
and expectations which the client and counselor 
perceive in the counseling relationship for dif- 
ferent types of problems and topics. This re- 
search suggests that a more systematic evalua- 
tion of client and counselor roles may lead to 
a better understanding of the dynamics of the 
interview, i.e., the interaction phenomena and 
variations in client and counselor behavior. 


Discussion 


We have found that discussion-topic and 
problem-area units when compared to a frac- 
tional unit (a) show greater sensitivity to 
variations in behavior during the course of a 
conference and (b) bring together client and 
counselor responses which reflect related be- 
haviors and attitudes to a greater degree. 
Thus, it seems imperative that any unit used 
in interview typescript research be based on a 
psychologically meaningful, organizing prin- 
ciple. That is, units should bring together be- 
haviors and attitudes which are of the same 
pattern, and partition those segments of the 
interview which are dissimilar psychologically. 
Discussion-topic and problem-area units met 
this standard. 

The thorough analysis of a single “typical” 
interview and general impressions from read- 
ing over 200 interview protocols suggested the 
possibility of counselor or client roles as a 
basis for unit divisions. A study of roles as- 
sumed in the counseling interview may lead 
to further understanding of the dynamics of 
the interview. 

Since this is one of the first studies which 
use counseling interview records from several 
institutions, it was felt that there would be 
some value in investigating whether the schools 


4For our purposes, Sargent’s [6] definition of 
role seemed useful. He says, “A person’s role is a 
pattern or type of social behavior which seems situ- 
ationally appropriate to him in terms of the de. 
mands and expectations of those in his group.” g 
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differ on the dimensions studied. Since the 
data secured represented a limited ‘sampling — 
three different clients in nine interviews— 
from each campus, the findings must be con- 
sidered very tentative. Nonetheless, some sig- 
nificant differences were found in problem 
areas discussed and in the pattern of techniques 
used. The findings therefore suggest that, in 
making studies which are concerned with the 
interaction of client and counselor, the dif- 
ferential distribution of problem types and the 
counseling approaches at each of the schools 
studied should be considered. 


Summary and Conclusions 


This study examined the relative effective- 
ness of three larger units used in interview 
typescript analysis. The three criteria used to 
examine effectiveness were: (a) reliability, 
(4) sensitivity, and (c) degree to which the 
unit brings together related material and parti- 
tions that which is less related. 

It was found that discussion-topic, problem- 
area, and fractional units could all be rated 
with acceptable reliability and that the rating 
reliabilities obtained were not significantly dif- 
ferent. On the other two criteria, it was found 
that both problem-area and discussion-topic 
units were more effective than quintiles of the 


interview series. Problem-area and discussion- 
topic units were not found to differ on these 
la. 

<a of the protocols suggested that 
changing client and counselor roles may be ad 
portant factors associated with variability wit a 
in the conference and are directly associate 
with topic and problem areas. Thus, the eo 
cussion-topic and problem-area units arm 
an opportunity to study such roles, but quintiles 
of the interview series do not. 
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On the Supposed Behavioral Correlates of an 
“Eye” Content Response on the Rorschach 


Michael Wertheimer 


Wesleyan University! 


a it is clinically of the utmost im- 
ihe indi, on know as much as possible about 
Wien a case, any kind of information, 
of iene a source, is often considered to be 
many at value. Thus one finds that in practice 
whose correlates for test behavior are used 
P empirical foundations are not optimal. 
that A Aon ONET has found in his experience 
attribute the to go with B, he may thenceforth 
give him py characteristic B to patients who 
standard dis a test, and soon it may become 
tjan” iagnostic practice to consider 4 a 
Sign” of B. 
waa situation is of course inevitable in a 
nos D capies as that of personality diag- 
armata there is such a great need for in- 
SDE Ao n. Much research is going on at pres- 
Progres: “Sipe sd this demand. Considerable 
of thier aS already been made in the revision 
experie Ty, such as in the areas of color shock, 
to me a balance, and diagnosis of organicity, 
recent ion only a few. Empirical devices have 
era y also been brought to bear on the gen- 
area of the content of responses on the 
rschach test, 
represe Present study attempts validation of a 
chosen ntative content item. The item was 
should oe regard to two criteria: first, it 
tion: ca relatively well-accepted interpreta- 
tively Second, it should be one which is rela- 
tae to test objectively. _— 
shagg tt [2] writes of Card IV, DL age 
characteristics of this region encourage 
a Perception of a ‘pair of eyes.’ Neverthe- 
and Persons with strong paranoid tendencies, 
id ; ose whose symptom complexes include 
eas of influence or reference invariably note 


This r eae a 
esearch erformed while the writer 

en USPHs Clinical Paychologist at the Worcester 
ate Hospital, 


the ‘eyes’ and express the opinion that they are 
‘looking at me.’ ” Elsewhere he states, “Per- 
sons with strongly paranoidal tendencies, how- 
ever, and whose symptom complexes include 
ideas of influence or reference, deliberately note 
the ‘eyes,’ abstracting them from the head of 
the insect or animal and adding the impression 
that ‘they are looking at me.’ Such responses 
appear with similar frequency from strongly 
inferiority-convicted persons. Among these 
such a response probably represents a projec- 
tion of the idea of being under the close scru- 
tiny of the examination” [3, p. 83]. Hertz 
writes, “Ideas of influence or reference may be 
detected by the persistence of eyes” [1, p. 15], 
and Schafer [4], in reference to paranoids, says 
that some of these patients emphasize “eyes.” 
While analyzing a Rorschach record, he 
writes, “On Card IV, under the impact of 
anxiety, his integrative ability is so impaired 
that he is restricted to the eyes of what is fre- 
quently seen as a full animal head (lower 
middle D), and misses the popular Æ (animal 
skin) altogether. On Card IX, another fre- 
tly disturbing card, precisely the same 
thing happens: after a long delay he makes out 
a pair of eyes, one of which is frequently in- 
tegrated into a full animal head. The choice 
of content ‘eyes’ can be considered a further 
indication of his paranoid trend .. .” [4, p. 
155]. Courses in practical Rorschach tech- 
nique often consider eyes as an important, or 
even an unmistakable sign of paranoid trends; 
and many workers in the field use it as an fine 
portant indicator in the practical everyday 
work of diagnosis. 

These statements about the relationship be- 
tween paranoid trends and eyes content seem 
to satisfy the two criteria of being well accept- 
ed and relatively easy to test. 


quen 
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Procedure 


The files of the Psychological Laboratories 
at the Worcester State Hospital were used for 
the purpose of astatistical check. Altogether, 
230 records were examined. An attempt was 
made to find 15 records of males and 15 of 
females in each diagnostic group. In some cate- 
gories less than 30 records were available, so 
that the N was not always the same from 

group to group. The diagnostic categories used 

were: (a) paranoid psychoses including schizo- 

phrenia and other paranoid conditions; (b) 

schizophrenia, other types, which can also be 

called the schizo-affective group; (c) non- 
paranoid and nonaffective schizophrenics, in- 
cluding simple, hebephrenic, and catatonic 
schizophrenics; (d) manic-depressive patients, 
whether manic, hypomanic, depressed, or 
mixed; (e) organic patients, including alco- 
holics, epileptics, and those with disturbances 
of the central nervous system; (f) neurotics, 

independent of further classification; (g) a 

group without psychosis, diagnosed simple 
adult maladjustment; and finally (4) psycho- 
paths. 

For each patient, age, sex, psychiatric diag- 
nosis, Stanford-Binet Vocabulary IQ and the 
total number of responses to the Rorschach 
were recorded. The record was then combed 
to find every occurrence of the word eyes, and 
the number of eye responses was recorded, with 
reference to whether they occurred in the free 
association or in the inquiry, and on which 
card they appeared. The original intent was 
also to record the detail which had given rise 


Table 1 


Michael Wertheimer 


to the response, but the data on the protocols 
were usually insufficient to give clear indica- 
tions of location. Records used were obtained 
in the period 1936 to 1952, from patients re- 
ferred to the psychological laboratories by the 
staff of the hospital. All were obtained by 
trained psychologists, ranging in experience 
from intern to director of psychological re- 
search. 


Results 

‘Table 1 shows the number of times that the 
word eyes occurred in response to the various 
cards. The table is based on the records ob- 
tained from the following groups: paranoid, 
schizophrenia other types, neurotics, and or- 
ganics; 119 records in all. Only 14 female 
organic records were found in the files. Lind- 
ner’s statement about Card IV that the ‘“shad- 
ing characteristics . . . encourage the percep- 
tion of a ‘pair of eyes’ ” is consistent with the 
finding that Card IV produces the most fre- 
quent mention of eyes. It must be mentioned 
here that the number entered in the table ue 
the number of times the word eyes appears 19 
the free association, plus the number of times 
it occurs in the inquiry, independent of con- 
text. 

In order to get a more adequate picture of 
the “importance” of eyes in a record, each 
record was corrected for the total number g 
responses. An eye index, the number of times 
the word eyes appeared in the record, divided 
by the total R of the record, was obtaine®: 
This eye index was plotted against [Q, 
order to see whether there was any relation- 
ship between the two. Lumping the, 
records into four groups, Table 2 was obtaine® 


The Incidence of Eye Responses on the Means and medians for each group are si 
Rorschach Cards and both show the same trend. The ae 
Card Number of Proportion difference between the means and the mei 
eye responses is due to the extreme skewness of the dam 4 
tion of the eye index; 91 of the 230 rec 
I 34 .09 ; 
II 29 08 
III 22 06 ‘Table 2 i 
IV 83 22 Eye Index as a Function of IQ 
iá 17 04 Median ey® 
$ IQ Range N Mean eye z 
vI 37 10 £ index inde* 
VII 26 07 ae 
wu 23 .06 60- 79 27 197 a 
Ix 54 14 80- 99 68 115 mn 
Fs 52 14 100-119 82 158 en 
Total 377 1.00 120-139 53 166 = 


Behavioral Correlates of “Eye 


pead a not a single eye response, and there- 
wi E 40% of the records had an eye 
cee ee 00. There is some indication in 

atistics that the middle range of intelli- 
gence seems on the average to be less produc- 
tive of eye responses on the Rorschach than do 
the extremes. 


To see whether the production of eyes on 
the Rorschach is a function of age, the eye 
index was plotted against chronological age- 
Sach a plot, when age is broken down into 
ive groups, gives ‘Table 3. Since the means 
we adequate picture of the relationship, 
the | is abe not given in the table, although 
Swed, "he are once more markedly 

. The increase in the number of eye 


Table 3 

Be range N Mean eye index 
10- 
ree 38 .100 
a 73 130 

64 135 
4 
oe 39 187 

ee a | a 


What 


re š 
ig aie with increasing age is clear. 
s is open to speculation. 
Woes 7a i the relation between eye Te 
Portio lagnosis, Table 4 shows the pro- 
ma of subjects who reported eyes on Car 
» divided into the various diagnostic groups: 


Table 4 


Th y 
€ Relation between Incidence of Eye Responses 


Proportion of 
S’s reporting 
eyes on card 


Dia . In free In 


Simple adult 


chin justment 03 28 e 
othe Phrenia, a0 
Sim ines 10 37 

pir €, hebephrenic, 

se] ace 33 30 

reni a3 . 

Psychopaths Ti 38 27 
TZanics 21 .29 29 
€urotics 13 A3 30 
aranoids A7 43 30 


” Response on the Rorschach 


191 


This result is somewhat discouraging in that 
we would expect the paranoid patients to 
stand out considerably above the others. Lind- 
ner’s strong statement that paranoids invari- 
ably” note the eyes is not consistent with this 
finding. Paranoid patients do, however, report 
eyes relatively frequently compared with other 
diagnostic groups. 

Table 5 shows the mean eye index for the 
various diagnostic groups; the result here is 


Table 5 


Eye Index As a Function of Diagnostic Group 


Diagnostic group ean eve index N 


Paranoids 178 30 
Neurotics 164 30 
Manic-depressives 142 25 

30 


Schizophrenia, other types 116 
Simple, hebephrenic, and 


catatonic schizophrenics 111 30 
Psychopaths .108 27 
Simple adult maladjustment .105 29 

.097 29 


Organics 


more encouraging, but it must be remembered 
that this is eye index for all cards, not specifi- 
cally for Card IV alone. 

It is clear from this analysis that a response 
ard IV, or a high eye index in the 
be used automatically to infer 
a subject who produces 


of eyes on C 
record, cannot 
paranoid ideation in 
such a record. 

It may well be objected at this point that 
psychiatric diagnosis is far from infallible, and 
that there may be features in a case which are 
more important than paranoid trends, and 
which force the psychiatrist to make a diag- 
nosis of something other than a paranoid dis- 
ease even though a patient may show clear 
suspiciousness. In an attempt to answer the 
critique, 4 further analysis was performed. A 
file of Keysort Cards, one for each patient ex- 
amined, was available in the office of the Di- 
rector of Psychological Research at the Wor- 
cester State Hospital. These cards include, 
among other information, a code for presence 
or absence of suspiciousness in the case history 
of the patient. Table 6 shows the analysis of 
the suspicious and nonsuspicious groups into 
records which showed at least one response of 
eyes on Card IV, as against those which did 


not; also those records in which at least one 
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3 Table 6 : 
The Number and Proportion of Patients Showing Eye Responses either on Card IV 
or on the Entire Record, as a Function of Whether Their Symptoms 
Included “Suspiciousness” or not. 
” 
Sign Not susp. Suspicious Total Sign Not susp. Suspicious Total 
Eyes on 51 35 36 Eyes in 86 53 139 
Card IV (34%) (45%) record (57%) (68%) 
No eyes 101 43 14 No eyes 66 25 91 
on Card IV (66%) (55%) in record (439%) (329%) 
All cases 152 78 230 | All cases 152 78 230 
Table 7 
The Number and Proportion of Patients Showing Two or More, or Three or More Eye 
Responses in the Entire Record, as a Function of Whether Their Symptoms 
Included “Suspiciousness” or not. 
Sign Not susp. Suspicious Total Sign Not susp. Suspicious Total 
2 or more 70 38 108 3 or more 55 33 a 
eyes in record (46%) (49%) eyes in record (37%) (41%) 
Less than 82 40 122 Less than 97 45 mg 
2 in record (54%) (51%) 3 in record (63%) (59%) 
All cases 152 78 230 All cases 152 78 230 


response of eyes occurred on any card as 
against those on which eyes were never men- 
tioned. 

Chi square was calculated for both of these 
two-by-two tables; in each case the probability 
that such distributions may have been drawn 
from a population in which there was no differ- 
ence in the production of eyes between the sus- 
Picious and the nonsuspicious groups was just 
under .10. Chi squares for the two tables were 
2.82 and 2.79 respectively; chi square corres- 
ponding to a p of .10 is 2.72; for p = .05, it 
is 3.84. By the generally accepted criteria of 
Statistical significance, therefore, it is suggested 
that neither production of eyes on Card IV 
nor production of eyes anywhere in the record 
differentiates between the suspicious and the 
nonsuspicious group. 

The mean eye index of the two groups, .156 
for the suspicious and .106 for the nonsus- 
Picious groups, is suggestive of a difference be- 
tween them. 

One other criterion of paranoid trends, that 
of Hertz, remains to be tested. It is claimed 


that the persistence of eyes in a record 1s e 
determining criterion of suspiciousness in pa 
patient. For analytical purposes, Table 7 g! 
the number of records showing two oF ear 
and three or more eye responses, for bot ight 
picious and nonsuspicious patients. his mi 
be one approach to the definition © Feet 
ence.” Chi squares calculated on both of of 
come out with probabilities of -70 and - ting 
obtaining such results by chance, suse ith 
that at least for the present sample, and mM no 
Persistence defined as recurrence, <r 
difference in the persistence of eyes be 
suspicious and nonsuspicious patients- ested 
A few other relationships were uer 
by the data. Females tend to have ales me 
responses in their records than do this resu 
dependent of diagnostic group; but t the sus- 
was not statistically significant. Also espons 
Picious group tended to have fewer *epicious 
in the whole record than the dalle sig 
but again this difference is not or $ the tw? 
nificant. The median values of R for he 


ivel 
groups were 15.5 and 16.6 respective a 


=- 
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means 18.7 and 19.2. 

At best, then, we can say that there might 
be some statistical trends in support of the 
Statements given in the introduction, but none 
of these trends reaches the criteria of statistical 
significance which are currently in use. Even 
if clearly significant statistical differences were 
found, this would still be a far cry from the 

invariable” type of relationship, the exist- 
ence of which is sometimes asserted in works 
on Rorschach content analysis. On the other 
hand, it must be said in all fairness that such 
Statements of one-to-one relationships are the 
ones which lend themselves most readily to 
quick empirical check. 


Discussion 


nefore further generalizations are made on 
i of these data, certain rather serious 
ulatio. erations must be mentioned. In the tab- 
üsd a completely objective attitude was 
eyes me very single time that the word eye or 
indepe = slay a check-mark was made. This 
sis re ndence from context, which the hypothe- 
Drie has both great advantages and 
ias a advantages, It makes it impossible for 
to affect h Part of the investigator in any way 
easy st the results; it is simple; and it permits 
ee s atistical analysis. On the other hand, 
may os ie approach to the hypothesis 
Naive rike the practicing clinician as rather 
incorr i that it may be considered obviously 
Tom ect to divorce the word eye completely 
tran, ba context. However, this is a direct 
Seon tion, into experimental terms, of the 
im ci approach to Rorschach interpreta- 
ten though the authors of such books may 
cont: Pay lip service to the importance of the 
ext of the response, still, in the usual form 
Spon entation; a one-to-one correlation of re- 
plied ¢ to diagnostic significance 1s either a 
sis pao necessary as a working hypar e- 
ida „the student. It may be argued that, for 
ne ctic purposes, such oversimplification 1s 
Sessary and justified. It may be, however, 
and this is the point of this study) that this 
thaq of teaching destroys the essence, an 
therefore the validity, of the technique. The 
to dings of this study certainly seem to point 
° such a possibility. Therefore this study aims 
at the evaluation of a method of teaching the 
°rschach, and may not have any immediate 


relevance to the interpretation of the Ror- 
schach by an experienced clinician, although 
some implications may be drawn for Rorschach 
interpretation in general. | 

It may well be that eyes in a record of a 
certain configuration may be highly related 
with paranoid trends, whereas another gestalt 
results in no predictive significance of eyes at 
all, i.e., there is a world of difference between 
the following response in the inquiry, “Well, 
this is his head; here are the ears, here is the 
nose, and here are the eyes and mouth,” and 
on the other hand, the response in the free as- 
sociation: “All I see on this are two eyes, look- 
ing straight out from the gloom.’ <A test in 
which, for example, a number of experienced 
Rorschach workers would be asked to rate each 
eye response should eventually be undertaken, 
but would be a test of a different hypothesis 
than the one tested here. 

The present tendency towards objectifica- 
tion and towards clear-cut statements of re- 
lationships places more and more Rorschach 
materials within reach of the experimenter’s 
techniques. On the other hand, the same type 
of approach, in making extremely explicit 
statements on the basis of clinical experience, 
may sometimes unavoidably carry the connota- 
tion of extensive empirical justification. Such 
an implication regarding a statement for which 
there is as yet insufficient data may blind work- 
ers in the field to the need for objective re- 
search. 

If one considers the present study as an ade- 
quate test of the hypothesis that the eye re- 
sponse, as such, tends to go with paranoid 
trends, certain further ideas offer themselves 
for consideration. 

First of all, this study suggests that the gen- 
eral acceptance of an interpretation is by no 
means an index of its empirical validity. Per- 
haps it is precisely the most commonly accepted 
interpretations which are the ones most criti- 
cally in need of objective analysis. 

Secondly, while the testing of the present 
hypothesis presents some difficulties, other re- 
lationships between test results and behavior 


2 There were less than ten records in the entire 
230 which included responses as extreme as those of 
the second type mentioned, and by no means all of 
these occurred in records of individuals who hid a 
paranoid disease or, whose case histories gave evi- 
dence of suspiciousness. 
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which have become traditional in the field of 
the Rorschach may be even more difficult to 
test. Such relationships may be less definite 
with respect both to test criteria and to be- 
havior correlates. It is less difficult to get ob- 
jective agreement on the presence or absence 
of a word in a record than on items such as 
F + 9%; on the behavior end, it is easier to 
determine the presence of paranoid trends than 
it is to determine the presence or absence of 
strong hostile desires which are well controlled 
and not acted out. 

Until further research is completed and the 
results made available to the practicing Ror- 
schach worker, perhaps it would not be amiss to 
emphasize caution in the interpretation of Ror- 
schach records. Whereas the general tendency 
in the field today is to make as ominous an in- 
terpretation as possible, at least in a mental 
hospital, perhaps the other extreme is more 
called for, if indeed one extreme is to be pre- 
ferred to the other. Since most of the indices 
in use at present are probably not nearly as 
accurate differentiators as we would have them 
be, we would be more likely to help a patient 
by making definite interpretations only of 
those few things on which there is good evi- 
dence, and for the remainder, by being aware 
of the many possible alternative implications 
(some perhaps pointing to assets and to health) 
and the good-sized margin of error. 

This study, then, indicates that particular 
caution should be exercised in making one-to- 
one interpretations, and leads to the suggestion 
that attempts to find objective Rorschach cor- 
relates for different behavior patterns would 
profit more by investigating the configurations 


and interactions of various indices, than by at- 
tempting to assign individual and invariable 
meaning to the indices. 


Summary 


Two hundred thirty Rorschach records from 
different diagnostic groups were examined for 
the frequency and incidence of eye content Te- 
sponses. Although much of the literature states 
that an eye content response to the Rorschach 
is indicative of paranoid or suspicious trends 
in the subject, this statement is not borne out 
by the present data. Paranoid patients did not 
produce significantly more eye content Te 
sponses than did other diagnostic groups, POY 
did patients whose symptoms include sus- 
piciousness produce more eye content responses 
than did patients whose symptoms did not 1n- 
clude suspiciousness. Caution is urged in the 
use of one-to-one behavior correlates of Ror- 
schach signs. 


Received October 20, 1952. 
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The Levy Movement Test: Suggestions for Scoring 
and Relationship to Rorschach Movement 
Responses 
Robert M. Allen, Charles D. Ray, and Robert C. Poole’ 


University of Miami 


in oo time there is little agreement 
the subject i determinants imposed by 
pour mn Rorschach ink blots [1, P. 

ment E ifficulty related to the move- 
the blots, į E? from the complexity of 
Omoa taus a the plates do not presenta 
of varying de stimulus field but are composed 
and eee. ees of form, shading, chromatic, 
third eae variables affecting perception. 
Nondirected em springs from the relatively 
subject nature of the orientation of the 

to the Rorschach task. 


Problem 


I ‘ 

variables pe ‘movement apart from other 
It would Cars in the Rorschach test situation, 
Eo e a i ETEO to limit the task 
Strum mplex stimuli. A new and simpler 
aa the Levy Movement Cards 
ee draws its value from being less sub- 
Stimuli h hese difficulties. This new set of 
Pose of a8 been developed for the express pur- 
aponga fa correlates of the movement 
achromati in the Rorschach. The plates are 
Mae r symmetrical, finger 
alf of the owing humanlike figures in eac 
simplify a canes Color is absent, ostensibly to 
sible rai e stimulus and to hold to a pos- 
Ing fro imum any determinant-complexes aris- 
hibit S the presence of hue which might in- 
encies alaia movement-respons¢ tend- 
task te s a further measure in orienting the 
to the perception of movement, the sub- 


bi 
ma € authors are indebted to Dr: Carl Williams, 
his y. aent of Psychology, University of Miami, for 
a able assistance with the statistical phase of 

er, 


ject 


the 


1 i - 
s kindness is greatly appreciated. 


ject is given the following directions when 
presented with the LMC: “I am going to show 
vement blots. These show people 
Look at the cards in the 
position in which I give them to you,? and tell 
me what the people are doing. When you are 
through, place the card face down on the table 
and I will give you the next one. Do you have 
any questions E 

In this paper the authors will (a) define 
and illustrate a simplified scoring scheme, and 
(b) compare the different types of movement 
concepts given to the LMC with those elicited 
by the Rorschach. In order to compare the 
movement data obtained from these tests a 
scoring system was devised for the Levy move- 
ment responses to parallel the Rorschach. ‘The 
system proposed by Levy [6] and Zubin [9] 
was too complex for handling such data. In 
place of their numerically detailed scales for 
rating compliance, movement, content, and 
psychological nature of the response, the re- 
vised scoring schedule includes the following 


elements: 


you some mo 
doing something. 


1. Empathy: the subject’s acceptance of the task. 
Rej—rejection of the card, no 1esponse given. X— 
response (s) other than movement given. N-Pr— 
movement response not spontaneous. Pr—movement 
response present and spontaneous. 

2. Movement: concept seen 1n motion. 

F—form oF other nonmovement response given. 
OM-—inanimate movement response (Klopfer’s m) 
AM—whole animal seen in motion (Klopfer’s FM) 
AdM—daetail of animal in movement. HM—whole 
human seen in motion (Klopfer’s M). HdM—de- 
tail of human in movement. 

3. Forces: contributions made by external (E) 
and internal (I) forces in the movement response 
as seen by the subject; also refers to the level of 


3 One card, VI, is presented in three differen: po- 
sitions consecutively. 
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Table 1 
. Summary of Productivity and Movement Responses for LMC and Rorschach Tests 
Total Human Animal Other Total 
Measure Responses Movement Movement Movement Movement 
LMC R LMC R LMC R LMC R LMC R 
Raw Mean 13.1 26.2 8.8 3.7 6 3.8 2 6 114 7.7 
Raw Median 11 21 10 2 0 3 1 0 10 7 
Percent Mean 78 15 3 14 11 2 92 31 
Per cent Median 90 10 0 12 8 0 92 31.6 


movement energy imposed in the concept. These 
may be equated with Rorschach flexor and extensor 
movement. 


£—mechanical, inanimate movement: falling, 
floating, balancing (by gravity), being pushed, 
blown apart, ete. 

£/I—static, positional animal or human move- 
ment: standing, leaning, poised, holding something, 
talking, sitting, breathing, etc. 

EI—active animal or human movement: walk- 
ing, bending, bird flying, fish swimming, etc. 

I/E — energetic animal or human movement: 
dancing, diving, swimming, running, jumping, 
fighting, walking or standing on hands, intercourse, 
etc. 


J—uncontrolled, fantastic, inanimate movement: 
exploding, etc. Movement must be forced from the 
internal, otherwise score E. 

4, Content: standard scoring as in the Rorschach 
test. 

5. Popularity and originality: apply Rorschach 
standards. 

Example: Levy Card VI, “Looks like two people 
in bathing suits, diving into a pool of water.” 
Movement response is spontaneous, Pr; human 
Movement seen, HM; movement is energetic, I/E; 
clothing and water mentioned, Clo, N. Scored: Pr 
HM 1/E Glo, N; Rorschach equivalent: W M 
H. 


Method 


In a preliminary study with 25 college stu- 
dents the above proposed scoring scheme proved 
to be adequate for representing and compar- 
ing the nature, content, and level of empathy 
of the movement responses in the LMC and 
Rorschach protocols. Each subject was admin- 
istered the two tests by the individual method 
and by the same tester. In every instance the 
Rorschach preceded the LMC Test. This pro- 
cedure was established because the LMC in- 
structions definitely set the subject to perceive 
human mcvement. Had these tests been given 


in the AB-BA order, the LMC instructions 
could conceivably influence the spontaneous 
production of movement responses in the Ror- 
schach plates. The results could be unnecessar- 
ily confounded by this variable. 


Results and Discussion 


An examination of the distributions of the 
responses reveals the nonparametric nature © 
the data and the consequent inability to assume 
normality. Table 1 presents movement-re 
sponse means and medians based on the abso; 
lute raw number of responses and the ratio © 
movement to total responses (percentage) 81V- 
en by each subject on each test separately: Ths 
total productivity for each test is also indicated: 
The number of raw mean and median tota 
responses for the Rorschach is double that for 
the LMC. Only three subjects have more 
than 15 responses in the latter test, none ns 
than nine; the limited range of 9 to 14 2 
sponses includes 84 per cent of the subject 
This is not surprising in view of the rigidity 
the LMC directions as compared with the The 
tive freedom of the Rorschach instructions. a 
LMC directions seem to imply that antes 
human movement percept relieves the su?) ail 
of the need for further response to the ¢# 
This is not so with the Rorschach tes ry? 

Again Table 1 reveals a dramatic ae 
the movement story. For this selected por de- 
tion, as a group, movement was a majo 


C re- 
terminant in 92 per cent of the Nall 
sponses and in 31 per cent of the hould be 


associations. As indicated above, this $ use 9 
the expected direction of variance beca arte 

the specific movement-perception set Sa by 
by the LMC instructions. This is sup. P into 
an analysis of the movement respons Using 
three types: human, animal, and other. e the 


: itigat 
the median percentage data (to mute 


The Levy Movement Test 


torting ies of extreme ratios), it may be 
ment sen able 1 that LMC human-move- 
movement, 60 ne greatly exceeds Rorschach 
movëiient, per cent to 10 per cent human- 
with the associations, respectively. In keeping 
iinit] attitudinal set, animal responses are 
elicits a Mena LMC while the Rorschach 
miskunn i of 12 per cent FM. Again one 
explanatior ik e LMC drawings for a possible 
ly elicited —— engrams are not as readi- 
easily reco DEA of the instructions and the 
fier io mie humanlike quality of the 
ous ink bl ings, much more so than the nebu- 
remains poa For future research, then, there 
ale re ae leh of evaluating the ration- 
est which e animal responses in the LMC 
Specific al a definite departure from 
Oth ructions, 
lieber far Taner concepts are consistently 
analysis of ae than for the Rorschach. An 
SPonses a „the contents of the subject’s re- 
ividual Tato oe to the structure of the in- 
association A plates which determines such 
and thts: „vind blowing,” “rain falling, 
are readil ing” movements — concepts which 
of the Ben engendered by the chiarascuro tones 
Natural se Paintings which are suggestive of 
iscloses ( Besar To recapitulate: Table 1 
for the LM aoe related to total productivity 
an analysis of and Rorschach tests, and (b) 
SOCiations ; of the three types of movement as- 
ns into human, animal, and other. 


6 Table 2 
Orrelation between LMC and Rorschach 
Movement and Total Responses 


Response Rho 
Human movement . s +4.20 
ote movement —.07 

movement ... —.08 
rete movement +.24 
otal responses i+.50 


The question which flows logically from the 


findings presented in Table 1 is: what 1s the 
thi avonship between movement associations of 

© LMC and Rorschach tests? Two nonpara- 
Metric statistics are utilized in order to ap- 
oo the answer to this question—rank cor- 
sation, tho; and Wilcoxon’s method for in- 
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dividual comparisons by the ranking: method 
[2, 4+, 7, 8]. Table 2 discloses the rho coeffi- 
cients between the types of movement responses 
obtained on the LMC and Rorschach tests and 
the correlation between the total number of 
responses for both tests. None of these values 
is significant for estimating a definite relation- 
ship between the two variables [3, p. 314]. 
One cannot state, if such an hypothesis entered 
into the considerations of the LMC propon- 
ents, that a high number of movement associa- 
tions in the LMC Test is necessarily accom- 
panied by increased movement responsiveness 
in the Rorschach ink blots, or vice versa. The 
same hypothesis is untenable for total produc- 
tivity on both tests. These findings suggest 
further that there is no acceptable means of 
predicting, for the individuals within the study 
group, to what extent productivity and move- 
ment engrams in one test will be reflected in 


the other. 
Table 3 


Significance of LMC and Rorschach 
Movement Percentages 


Response 
eS SL 
Human movement 
Animal movement 
Other movement 
Total movement -- 


An examination of the raw percentage dis- 
tributions of the responses leaves the impres- 
sion that, as a group, there are some signifi- 
cant differences in LMC and Rorschach re- 
sponsiveness. The percentage data were ana- 
lyzed for significance in accordance with Wil- 
coxon’s method [7, 8].* The probabilities are 
presented in Table 3. The implications are 
clear: there are significant differences in move- 
ment-determined concepts for the group on the 
LMC and Rorschach tests. Human-, other-, 
and total-movement responses are elicited more 
prominently by the LMC; animal-movement 
associations are predominantly engendered by 
the Rorschach ink blots. These results support 
the data reported in the earlier portion of the 


paper. 


4This is a nonparametric test based on rank 
order and is knowr as Wilcoxon's T test. No as- 
sumption of normality of distribution is made. 
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Conclusions 


Can the LMC Test be employed as a means 
for checking the Rorschach movement respon- 
siveness of a subject? It would appear that the 
present findings, with this group of subjects, 
militate against such an hypothesis. All that 
may be concluded is: (a) The Levy Move- 
ment Card Test elicits a significantly higher 
percentage of movement responses than does 
the Rorschach Psychodiagnostic Test. (b) 
The LMC Test is less productive of total re- 
sponses than the Rorschach. (c) While the 
above two conclusions hold for this study popu- 
lation as a whole, prediction for an individual 
subject’s total and specific type of movement 
responsiveness cannot be made. Thus, it is 
difficult to evaluate high or low productivity 
bya subject in one test in terms of productivity 
in the other test, (d) As a final opinion, pend- 
ing futher research, the authors believe that 
the greater degree of Structure in the LMC 
instructions and the nature of the drawings 
themselves could account for the results ob- 
tained. The authors suggest that much more 
work has to be done with the LMC Test be- 
fore it may justifiably be employed as a check 
on Rorschach movement responsiveness, 


Robert M. Allen, Charles D. Ray and Robert C. Poole 
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Prognosis in Paranoid Schizophrenia on the Basis 
of the Rorschach’ 


David 


Grauer 


Veterans -Administration Hospital, Hines, Illinois 


e: i pa published prognostic investigations 
So cet on schizophrenics have made 
subtype sie attempt to isolate the paranoid 
ature is special study. Evidence in the liter- 
type is pie suggests that the paranoid sub- 
Merits rie i tee „from others and therefore 
14, 22 a ee a special group [2, 11, 
Was conn k For this reason, the present study 
Several i fo paranoid schizophrenics. 
Prognostic Investigations of the Rorschach as a 
been re instrament. I schizophrenia have 
Ported [8, 9, 13, 15, 16, 17, 19, 20, 
Pa ee - the studies has discovered combi- 
istinguis] orchach signs which significantly 
op hrenics aap tenes from unimproved schiz- 
Sistencies here are, however, many incon- 
signs fou ps contradictions in the specific 
investigatio to be prognostic, even among the 
tributed Hons iof the psychologist who has oor 
recent maaSE to this literature [19, 20, 21]. 
er review by Windle [25] summarized 
sults of many of these prognostic studies. 
Se rois explanation for the diversity of 
Present ings cannot, of course, be given 1n the 
it is cle State of our knowledge. Nevertheless, 
are dera that a majority of the investigations 
Place Sent in many respects. In the first 
Purely A ognostic signs were established on b 
Scores “(mene basis by comparing Rorschach 
Phren; oF improved and „unimproved schizo- 
nics. There is a striking paucity of hy- 
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potheses in these studies. Since most of the pa- 
tient samples are small and almost no cross 
validation is reported, it is obvious that, as 
Cronbach [5] has recently emphasized, the re- 
liability of the results is open to question. 
Finally, in view of the fact that the groups 
differ from one another in age, sex, intelli- 
gence, subtype classification, etc., it is perhaps 
not surprising that different prognostic signs 
were obtained. 

The hypotheses for the present study were 
derived mainly from the prognostic investiga- 
tions of schizophrenics by psychiatrists. Among 
the favorable prognostic signs most commonly 
reported in the literature [3] were a relatively 
well-adjusted prepsychotic personality, and the 
presence of affective features in the clinical 
picture. These observations form the principal 
basis for our operational hypotheses. 


Problem 


The aim of the present study was to in- 
vestigate the value of the Rorschach in pre- 
dicting the outcome of treatment of paranoid 
schizophrenics. It was assumed that the con- 
flicting results obtained in previous prognostic 
investigations were due, in part, to the inade- 
quate control of various factors. Among the 
most important of these factors, it was be- 
lieved, is that of subtype classification. In the 
present study only patients diagnosed as para- 
noid schizophrenics were included. 

This investigation differed from most of the 
other prognostic studies in at least one signifi- 
cant respect. No attempt was made to arrive 
at a combination of signs to distinguish im- 
proved from unimproved groups on a purely 
empirical basis. The purpose of all of the 
group comparisons made here was to test cer- 
tain hypotheses or predictions, and at the same 
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time to.re-examine certain prognostic signs 
cited by previous investigators. 

The main reliance in this study was on rela- 
tively “objective” signs and techniques of 
measuring Rorschach variables. The author is 
aware of objections to this procedure that may 
be raised by clinicians, and of the limited 
validity and reliability of the “scales” used. 
Nevertheless, it is felt that such methods are 
most feasible in the present state of knowledge, 
and in view of the similar techniques applied 
in previous research in this area. 

One chief hypothesis was that schizophrenics 
who improve should reveal evidence of a great- 
er degree of anxiety in their Rorschach records 
than those who fail to improve. This hy- 
Pothesis was based on an inference from one 
of the most frequently noted clinical observa- 
tions, that schizophrenics who improve are 
more likely to manifest affective reactions 
(presumably including anxiety) than those 
who fail to improve. Furthermore, it seems 
reasonable that anxiety in a schizophrenic is 
indicative of an active struggle with the psy- 
chotic process. Such an attempt to regain con- 
tact with reality is in sharpest contrast to the 
apathy and withdrawal exhibited by typical 
deteriorated schizophrenics. 

Another major hypothesis was that schizo- 
phrenics who improve should give evidence of 
having possessed a relatively better adjusted 
Prepsychotic personality than unimproved pa- 
tients. This would conform to the conclusion 
of Klopfer and Kelley regarding prognostic 

signs in the Rorschach: “The more the pre- 
treatment record approaches ‘normal,’ the 
better the prognosis” [14, p. 368]. It is also 
in agreement with results of investigations of 
Prepsychotic histories of schizophrenics. 

A minor hypothesis considered was that im- 
Proved patients should show less evidence of 
organic brain damage than unimproved. This 
supposition is based on the belief held by Bel- 
lak [4] and others that schizophrenia may be 

either of organic or psychogenic origin, or may 
involve varying degrees of each factor, and that 
the more favorable Prognosis would be expect- 
ed in those cases in which there are fewer or- 
ganic factors, 


Method 
To test’ the hypothesis that anxiety is a favor- 


able prognostic factor, Elizur’s Rorschach con- 
tent test [7] was employed. This test was 
designed to measure degree of anxiety and 
hostility manifested by the content of Ror- 
schach responses. In view of the reliability 
and validity reported by Elizur, this device 
was considered appropriate. 

Since it was believed that measures of 
“neurotic tendency” as indicated by Rorschach 
responses would give another indication of 
anxiety, the “neurotic signs” of Miale and 
Harrower-Erickson [10] were also used in 
this study. 


To test the prediction that improved schizo- 
phrenics would show more nearly “normal” re- 
sponses in their pretreatment Rorschach than 
unimproved patients, the following Rorschach 
factors were compared: total number of re- 
sponses, distribution of whole and detail re- 
sponses, number of human movement, color, 
shading, good form, space, human, and anato- 
my responses. As these components have been 
those most frequently compared in past studies, 
it is possible to relate the results to those of 
other investigators. 


In addition, the data were analyzed for the 
most recent Rorschach prognostic signs report- 
ed by Phillips [17] and Piotrowski [21]. 
Records were scored for Phillip’ “Color 
Drive,” a scale purporting to measure “affect- 
tive drive” based on the subjects’ color re- 
sponses. The Rorschach protocols were also 
scored for the six Piotrowski signs: “Variety, 5 
“Generic Term,” “Evidence,” “Color | Re 
sponse,” “Indirect Color Approach,” and “ De- 
murring.” These terms are defined and illus 
trated in the last of Piotrowski’s reports i 


Source of data and subjects. Al clinical 
records of patients diagnosed as paranoid ae 
ophrenics who had pretreatment Rorchach Ta 
during 1947 and 1948 and were sage 
Hines VA Hospital were examined. on foe 
ing the records for the present study, the 
lowing criteria were used rigorously: 


i sis of 
1. All patients included had a final cree aniti 
“paranoid schizophrenia” after at least t! de by two 
of hospitalization. This diagnosis was ants (In 
Psychiatrists, one of whom was a cons “consul- 
the Veterans Administration Hospital 2. univer- 
tant” is a specialist who is affiliated bier oe in his 
sity and has attained a recognized stai 


field.) 
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2, Th a z arai . . 
E — Was positive evidence in the case record 
Te se patient had hallucinations or bizarre de- 
sions before treatment. 


‘anton ey classified as “improved” if they 

improved a ren the hospital as in remission or 

experienced oe evidence that they no longer 

aer elusions or hallucinations. The “un- 

were A consisted only of patients who 

long-term a ed for transfer to an institution for 
spitalization. 


Ml i to meeting the criteria de- 
rs ere Patient in the improved group 
improved Ned in age with a patient in the un- 
ords of prop Out of 140 Rorschach rec- 
were fou ne schizophrenics, 36 patients 
who fulfille 18 improved and 18 unimproved, 
Patients =o all these requirements. All the 
sall pe males and veterans of World War 
ment eerie some form form of shock treat- 
od from Toy or electroshock) during the peri- 
7 to 1949, 
age aE groups were similar not only in 
ean ages f in IQ and in years of schooling. 
28.3; me: S tor the two groups were 28.1 and 
of school. IQ’s, 98.8 and 101.4; mean years 
Nificant ie 9.2 and 10.7. No statistically sig- 
tion ion erences in intelligence or in educa- 
Number h, found. In both groups a small 
tion fo ad histories of previous hospitaliza- 
r mental illness: seven of the improved 
' of the unimproved. In addition to 
treatment, four patients in each group 
also given some form of psychotherapy. 
Wo ay important difference between the 
Ment a was In duration of hospital treat- 
i n a unimproved group remaining almost 
ated t rr as the improved group. This is 
an of , n e fact that more of the unimproved 
Msulin the improved patients received both 
fail to and electroshock therapy. Patients who 
are ofte enefit from one form of shock therapy 
n given another form. 
Minister ee examinations were ad- 
enced ed and scored or supervised by experi- 
_ clinical psychologists. In each case the 
minations were given prior to treatment. 
ident? rotocols were typed and all scoring and 
Origin R information of both patient = 
ere th examiner were removed. The a $ 
ep en rescored independently by psychol- 
other than the Rorschach administrator. 
Chee were thus two independent scores for 
*Y Rorschach response. The present writer 
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checked each record in detail and, where dif- 
ferences in scoring occurred, made the final 
decision. The rescoring was done, of course, 
without knowledge as to whether the record 
belonged to the improved or unimproved pa- 
tients. The records were scored in accordance 
with Beck’s [3] system. Animal movement 
responses and form percentages as defined by 
Klopfer [14] were added for special scoring 
purposes. 
Results 


Rorschach scores as prognostic indicators. 
Table 1 presents the mean pretreatment scores 
of improved and unimproved patients on 
various Rorschach components. The only sig- 
nificant differences are as follows: The im- 
proved patients produced fewer total responses, 
higher 47%, and fewer D’s than did the un- 


Table 1 
Mean Scores of 18 Improved and 18 Unimproved 
Paranoid Schizophrenics on Rorschach Components 


f 
2d v 
7 a S 
az -Y T3 $ A 
i 5 © > oR E H 
pe g£ gE = i 
gs sé =E B82 aS 
R 17.3 29.1 2.12 2.60* 
Ww 6.6 5.7 0.71 0.78 
W Jo 42.6 25.6 2.599 2.60* 
D 9.6 17.3 2.36* 3.23%% 
D% 51.6 60.9 1.89 1.37 
Dd 11 6.1 1.65 2.00 
Dd % 5.9 13.6 1.42 197 
s 0.9 29 071 192 
M 1.3 22 142 178 
TY 1.2 18 1.65 1.52 
Sum Y 1.3 2.3 0.24 0.92 
FC 0.5 1.0 189 147 
CF 14 1.8 1.18 1.22 
Sum C 2.1 3.1 0.47 1.26 
F plus % 174 70.9 0.94 1.39 
H 1.3 24 0.94 1.59 
H% 121 17.9 047 124 
An 1.7 2.0 0.71 0.41 
An% 8.9 68 0.24 0.63 


* Significant at the .05 level of confidence. 

++ Significant at the .01 level of confidence. 

+The “sign test,” described by Johnson [12] does not 
make any assumption regarding normality of distribu- 
tion (as does the ¢ test). Since many of the Rorschach 
variables may not be normally distributed, it was decid- 
ed to use both tests of significance. These sigma values 
are approximations, based on the “normal curve.” Since 
the data used in computing signs are not continuous, 
significance was established by referring to the table of 
Dixon and Massey [6]. 
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improved group. The other differences were 
statistically insignificant. The trend of the re- 
maining differences may be summarized as fol- 
lows: Improveďł patients exhibited fewer 
human movement, fewer shading, and a small- 
er number of color responses than unimproved 
patients. Since the latter factors depend to 
some extent on total number of responses, these 
results were not entirely unexpected. The 
smaller number of total responses given by 
improved patients, together with the trend 
toward a restriction of color and movement 
responses, suggested that Rorschach records of 
improved patients tend to resemble the records 
of neurotic more than they do those of normal 
individuals. The prediction that improved 
patients would produce more nearly “normal” 
records than unimproved patients is thus not 
borne out by the data. This finding is opposed 
to the evidence from many previous investiga- 
tions and to the previously cited conclusion of 
Klopfer and Kelley [14]. 

“Neurotic signs” as prognostic indicators. In 
order further to test the hypothesis that im- 
proved patients would demonstrate more evi- 
dence of neurotic tendency than unimproved 
patients, the revised check list of Harrower- 
Erickson [10] was applied to the Rorschach 
data. Improved patients scored higher on the 
Harrower-Erickson check list of “neurotic 
signs” than unimproved patients: improved pa- 
tients’ score, 6.97; unimproved patients’ score, 
5.64. The difference between the two groups, 
however, was not statistically significant. The 
general trend of the data was, nevertheless, in 
the direction of confirming the hypothesis, and 
consistent with the restricted Rorschach rec- 
ords of the improved patients and with the re- 
sults to be described in the next section. 

Anxiety and hostility as prognostic signs. 
One of the principal hypotheses was, it will 
be recalled, that improved patients would show 
greater anxiety than unimproved patients. 
Elizur’s [7] Rorschach content test was select- 
ed to measure anxiety. Since this test also is 
designed to measure degree of hostility on the 
basis of content, the latter variable was also 
scored for both groups on an exploratory basis. 

Since the scores on the RCT are calculated 
by adding the scores of separate Rorschach re- 
sponses, it can be seen that there is a direct re- 
lationship’ between total number of responses 
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and total anxiety or hostility scores. In his 
report Elizur indicated that only records con- 
taining a specified range of scores were used. 
In view of the disparity in total number of 
responses between the two groups, it was neces- 
sary to make a correction by equalizing the 
total response scores, by totaling the separate 
scores and dividing by the total number of re- 
sponses for each Rorschach record. The re- 
sults were then expressed in terms of average 
anxiety or hostility score per response. 

The results were as follows: The mean 
anxiety score per response for the improved 
patients was .44; for the unimproved, .23. The 
t ratio of 4.02 is significant at the .01 level of 
confidence. According to the “Sign Test, 
(See Note, Table 1), the significance also 
reaches the .01 level. In 15 of 18 comparisons, 
improved patients scored higher on the anxiety 
scale than unimproved patients. 

The mean hostility score per response for 
improved patients was .07 ; for the unimproved, 
17. The ż ratio was 2.00, which approaches 
the .05 level of confidence. On the basis 0 
the “Sign Test” it is significant at the 0 
level. The improved patients showed less 
hostility than the unimproved group on this 
scale. 

The prediction that improved patients would 
exhibit more anxiety in their Rorschach records 
than unimproved patients was, therefore, ful- 
filled. An additional finding was that improve 
patients also show a definite trend toward 4 
lower degree of hostility than unimproved Pa- 
tients. 

Prognostic value of “Organic signs.” or 
hypothesis suggested by the literature is tha 
schizophrenics who fail to recover should show 
more evidence of brain damage than those W o 
do. To test this hypothesis, the data oe 
evaluated in terms of Piotrowski’s [18] his 
ganic signs.” The results failed to confirm = 
hypothesis. The mean number of aoe 
signs for the improved was 3.17; for mhe oe 
improved, 2.67. The difference is not st@ 
cally significant. 

Prognostic signs found by 
trowski. An attempt was made to a 
Rorschach data of our paranoid schiz 
on the basis of Piotrowski’s [21] six P 
signs (Variety, Generic Term, Evidence, d 
Response, Indirect Color Approach, an 
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oe oiie 

Siperlenved these signs, the present writer 

icity considerable difficulty in making 

cases. Ney ee their existence in many 

whale a ertheless, it is felt that, on the 
i » the results are fairly reliable. 

y ens oP Ee 0 analyze our Rorschach data 
ative results pee owski s six signs yielded neg- 
contained 43 Fan improved patients’ records 
All but ne signs; the unimproved, 4.1 signs. 
three or a ER in each group attained 

nding ahan signs, In contrast to Piotrowski’s 
Phrenics saree — of his improved schizo- 
few of his ur three or more signs, while very 
thermore plein patients did so. Fur- 
the improved = walls SIX signs distinguished 
a Statistically ee the unimproved patients at 

imitarly Significant level. ; 
When Philli 5 omg results were obtained 

Orschach w three signs were applied to the 

“Demurrin data. T hese three signs were: 
% bet R (one of Piotrowski’s six signs), 
ween 15 and 25, and “Color Drive” 


Score TI 
criterion tt was no difference in the 9o 
5 » four patients in each group respond- 


ing w: 
i AE between 15 and 25%. The total 
was 2.8; rin Score for the improved group 
response la the unimproved, 2.7. Scores per 
Rlimben of eee for disparity in total 
erence iain acy likewise showed no dif- 
Tesponse ies the groups: mean score per 
Or the mE the improved group being -10; 
hug o proved, .09. 
lips rae neither the prognostic signs of Phil- 
tinguished oe of Piotrowski successfully dis- 
aranoid the improved from the unimproved 
schizophrenics. 


Discussion 


T ‘ 
: ors finding that evidence of anxiety in the 
a liste ore of paranoid schizophrenics 
Sy € sign is in keeping with the clini- 
Metitioned ee of psychiatrists. As already 
€ Clinica] the presence of affective factors in 
A meN picture is one of the most frequent- 
ater rec characteristics of schizophrenics who 
Sidereg over [4]. Since anxiety would be con- 
: „an affective reaction, the results con- 
iano ical-psychiatric data on prognostic 1n- 
i > Perhaps anxiety is a favorable in- 
because it implies a struggle with the 
Process. Such a condition contrasts 
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markedly with the inertia, blunting of affect, 
and general apathy characteristic of chronic 
and deteriorated schizophrenics. 

Previous Rorschach prognostic studies rare- 
ly mention anxiety as a prognostic sign. Never- 
theless, some of the signs found by Piotrowski 
and Phillips, though they are not designated 
as such by these authors, could be interpreted 
as indicative of anxiety. Piotrowski’s [21] 
description of two of his signs, “Evidence” and 
“Demurring,” suggests that basically these 
factors may be an expression of anxiety. “Evi- 
dence” is scored when the subject indicates he 
is weighing the evidence regarding adequacy 
of response by using terms expressing doubt. 
“Demurring” relates to the subject’s holding 
back responses in order not to commit himself 
to interpretations of which he is not certain. 

Similarly, many features of Phillips’ [17] 
“Color Drive Scale” are identical with 
Elizur’s criteria for scoring anxiety in the 
Rorschach. Both scales give positive weights 
to responses like “blood,” “fire,” and others 
suggesting Stress and danger. 

The other positive findings—that hostility 
is an unfavorable sign—has also not specifical- 
ly been mentioned in the literature of Ror- 
schach investigators. Two recent clinical 
studies of delusions of schizophrenics do, 
however, tend to substantiate this result. 
Seitz [23] and Albee [1], in separate investi- 
gations, reported that there is greater likeli- 
hood for improvement if a schizophrenic’s delu- 
more intrapunitive than extra- 
punitive mechanisms. This finding would at 
the same time corroborate the previous conclu- 
sion that anxiety is prognostically favorable. 

The second major hypothesis—that Ror- 
h signs pointing to a relatively good pre- 
psychotic adjustment indicated a favorable out- 
come—was not confirmed by the data. This 
lack of confirmation of previous Rorschach 
findings requires some explanation. It should 
be noted that, while there is considerable vari- 
ation in specific signs cited as prognostic by 
different investigators, there seems to be a defi- 
nite tendency for “favorable” Rorschach signs 
to be associated with a good prognosis in the 
majority of the investigations. Why should 
the paranoid group show a reversal of this 


sions manifest 


schacl 


trend? 
One possible explanation lies in the nature 
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of the main positive finding, that anxiety is 
a favorable sign. As might be expected, anxie- 
ty resulted in a constricted Rorschach record 
for most of the improved patients. Such a 
record would show lowered productivity and 
consequently a reduction or elimination of 
those movement or color responses that reveal 
the more positive aspects of personality. In 
other words, the effect of anxiety would be to 
inhibit the expression of favorable personality 
factors. Perhaps the paranoid group, being the 
subtype in which control is the most rigid [2], 
is the one where the presence of anxiety, if it 
exists, would be the most conspicuous favor- 
able sign. In other varieties of schizophrenia, 
where there is less intellectual control, there 
may be a greater opportunity for release of 
those responses in the Rorschach which are in- 
dicative of inner resources and capacity for 
emotional rapport. 

In view of the ill-defined nature of the diag- 
nostic classification of schizophrenia, there is 
a great need for precise descriptions of the 
particular group selected for observation, as 
well as of the type of treatment given. Better 
measures of results of treatment are also re- 
quired. Although the present data fall far 
short of ideal in all these respects, the investi- 
gation was limited to a fairly well-defined sub- 
group of schizophrenia with specified behavior- 
al characteristics. Confirmation of the results, 
which is necessary if reliance is to be placed on 
them, should come from a repetition of this 
type of investigation on a similar group of 
paranoid schizophrenics. 


Summary 


This investigation dealt with the prognostic 
value of the Rorschach in paranoid schizo- 
phrenia. It was felt that previous prognostic 
studies were inadequate because of failure to 
control various factors, particularly that of 
subtype classification. The chief aim of this in- 
vestigation was to test certain hypotheses re- 
garding prognosis from Rorschach records of 
paranoid schizophrenics. 

_The pretreatment Rorschach records of 36 
diagnosed paranoid schizophrenics, who were 
subsequently given shock treatment, were 
analyzed to determine the presence of prog- 
nostic signs that would distinguish the im- 
Proved from the unimproved patients. The 
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sample consisted of 18 improved and 18 unim- 
proved subjects matched, by pairs, for age 
There was no statistically significant difference 
between the two groups in IQ and in educa- 
tional level. a, 

The following results were obtained : The 
pretreatment Rorschach records of improved 
paranoid schizophrenics contained evidence © 
a greater degree of anxiety than did the records 
of unimproved patients. Mean anxiety score 
per response on Elizur’s Rorschach content 
test differentiated the two groups at a statistl- 
cally significant level. Improved patients also 
manifested significantly less hostility than un- 
improved patients. There was some tendency, 
though not statistically significant, for 1m- 
proved patients to exhibit more “neurotic 
signs” in their Rorschach records than unim- 
proved patients. On the average, Rorschac 
records of improved paranoid schizophrenics 
tended to be less productive and to contain 
fewer movement and color responses than those 
of the unimproved group. The latter results 
are in harmony with the previously cited find- 
ings of greater anxiety in the improved Pa 
tients. 

No difference was found between improved 
and unimproved patients in total number © 
Piotrowski’s “organic signs” in their Rot 
schach records. An effort to confirm spec! 
Rorschach prognostic signs found by previous 
investigators yielded negative results. n 

An attempt was made to rationalize the pos” 
tive findings in this study and to integrat? 
them with previous prognostic indicators 7°” 
ported by psychiatrists and clinical psycho 
ogists. 


Received November 3, 1952. 
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A Comparison of Scores on the Index of Adjust- 
ment and Values with Behavior in Level- 
of-Aspiration Tasks’ 


Robert E. Bills 
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Many writers have expressed the opinion 
that level of aspiration, obtained from experi- 
mental studies, samples a type of behavior 
which is characteristic of subjects’ goal-setting 
behavior in general. In the experimental tasks, 
a subject is given practice and, after being in- 
formed of his level of performance, is asked to 
state his level of aspiration for the next trial. 
This is the most common method for assessing 
level of aspiration. Another possible method of 
measuring level of aspiration is by determining 
the discrepancy which exists between the con- 
cept of self and the concept of the ideal self. 
The latter type of aspiration is a resultant of 
the self percepts and the ideals held by a per- 
son, and may or may not be comparable with 
the level of aspiration represented by the simple 
tasks usually used in level-of-aspiration studies. 
One of the purposes of the present study was 
to investigate the extent of the relationship 
between level of aspiration as determined by 
motor and verbal tasks and personal level of 
aspiration as determined by the Index of Ad- 
justment and Values [3]. 


The Index of Adjustment and Values. The 
Index of Adjustment and Values requires that 
a subject make three ratings, on a five-point 
scale, for each of 49 traits. These ratings have 
been grouped into three measures: concept of 
self, acceptance of self, and concept of the ideal 
self. The discrepancy between concept of self 
and concept of the ideal self is a measure of 
the level of aspiration set by a subject in re- 


1 This study was made possible through a grant 
by the University of Kentucky Research Fund. The 
author wishes to express his appreciation to the 
committee in charge of the fund and to Glen E. 
Roberts who worked as assistaht on the project. 


spect to his ideals. The Index has been shown 
to be valid as a measure of emotionality [2, 9], 
and is capable of distinguishing personality 
types [1]. i 
o e of the study. It was predicted, 
on the basis of the reasoning described above, 
that personal level of aspiration as revente 
by the Index would be significantly correlates 
with level of aspiration as determined by ex- 
perimental tasks of a motor and verbal char- 
acter. 

Eysenck [4], in a study of the level-of-as- 
piration behavior of hysterics and dysthym!cS 
demonstrated that his hysterical cases were 
more variable in the levels of aspiration they 
set than were his dysthymic cases. 

A Rorschach study [1] of high and low 
scorers on acceptance of self as measured bY 
the Index of Adjustment and Values showe 
that high and low scorers constituted two dis 
tinct personality groups, and that the low 
scorers showed more rigid and less varia e 
Rorschach records than did the high scorers. 
On the basis of this result and Eysenck’s find- 
ings it was predicted that a group of subjects 
with acceptance-of-self scores below the pop“ 
lation mean of the Index would be less var™ 
able in the level of aspiration they set than 
would a group characterized by acceptance e 
self scores above the population mean of t 
Index. 7 

It should be possible in a controlled sain 
such as a level-of-aspiration experiment, ity 
demonstrate relationships between person? 


í In 4 

measures and observations of wy eee 
i i n tha à 

previous study [3] it was show: ive 


ance of self is related to direction of ele 
threat. Subjects who scored above the p 
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at oo P ‘Beseptance of self as measured 
blamed Pete ae ef Adjustment and Values 
nines ie outside themselves for unhap- 
the mean bi ad experienced, but subjects below 
ihercfore mee themselves. It was predicted, 
who score I soe present study that subjects 
self, mts above the mean on acceptance of 
Wud: res gen about their performance, 
iors Wee ah differently from subjects who 
More aa i mean on acceptance of self. 
a) Subjects « és it was hypothesized that: 
Mean on a who score below the population 
ndex, will ceptance of self, as shown by the 
Wiiecnben pa ere neti their performances 
mean on ek an subjects who score above the 
Score Bg ei of self; (b) subjects who 
of self, wher ne a pein mean on acceptance 
Ormance ai asked to recall their level of per- 
Member thei SF a0 interpolated task, will re- 
true Pelor performance as being above their 
elow the nance level and subjects who score 
formance eit will recall their level of per- 
Jects who are nha lower than it was; (c) sub- 
acceptance , h elow the population mean on 
feel about of self, when asked, “How do you 
negative As performance? will express 
who are ab ernalized attitudes while subjects 
Press posit nag the population mean will ex- 
e, externalized attitudes. 


Design 


y female subjects were selected, from 
tudents at the University of Kentucky, 
; basis of discrepancy scores on the Index 
jects haa ini and Values. The selected sub- 
on diser scores distributed from high to low 
n epancy. 
one nan subject was given, individually and in 
the orde on, five level-of-aspiration tasks with 
ized to p of presentation of the tasks random- 
Selected Prevent serial effects. The tasks were 
Verbal a, 2 represent a variety of motor an 
Ve ‘etn and mixtures of the two. The 
arget g included; 1, dart throwing; 2, Rotter 
Lonst Aspiration board [11] as modified by 
Stituting [8]; 3, marking out letters; 4, sub- 
ees letters; and 5, addition. , 
given the dart-throwing task each subject ye 
Point, darts, and the score was the a 
Otter a on all five darts. The modifie 
accom: oard was a board with a groove to 
modate a marble, on which depressions 


Thirt 


‘Mong s 
on the 
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were made at regular intervals to stop the 
marble. The center depression scored six and 
depressions on either side were on a descending 
scale to one point. Each subject rolled the 
marble five times for each trial. In the mark- 
ing-out test, the subject was given a paragraph 
and instructed, “Mark out as many e’s as you 
can. You have two minutes.” The substitu- 
tion test consisted of a series of letters with 
a blank space beneath each. At the top of the 
page was a key. Subjects were instructed to 
place below each letter the correct letter ac- 
cording to the key. Two minutes were al- 
lowed on each series. The arithmetic tests 
eries of five two-place numbers. The 
ed in a different order in 
each series but the problems on all the series 
contained the same combinations. The time 
limit was two minutes. At the beginning of 
each task the subject was requested not to at- 
tempt to add his own score. 

In each task the subject was given a series 
tice trials and then informed of his score 
on the last practice trial. He was then told, 
“The next trial is a test. How much do you 
expect to make?” The subject was told his 
score on the test trial and his performance was 
recorded. He was then asked, “How much 
do you think you should make the next time?” 
Performance was recorded and the subject was 

h do you think you scored ?” 


asked, “How muc 
The subject was then told, “You scored... . 
test. How do 


This is your score on the? «ss; i 
you feel about your performance?” The sub- 
ject’s remarks were recorded verbatim. 

‘After the five tasks had been completed, the 
subject was handed a mimeographed page and 
instructed, “Read this as rapidly and care- 
fully as possible.” The experimenter pretend- 
ed to make notes and to time the performance. 
This exercise was included to separate the 
tasks from recall of performance. After the 
subject had completed the reading of the ex- 
t, he was asked to recall his performance 
k. Recall was recorded and cer- 
all was judged on a five-point scale 


were s 
digits were arrang' 


of prac 


cerp 
on each tas 


tainty of rec 
by the experimenter. 


Results 
The experiment yielded data of four tynes 


including: level-of-aspiration scores, estimates 


of performance, recall of performance, and at- 


208 


titude toward performance. These will be dis- 
cussed below. 

Index scores and level of aspiration. Sub- 
jects were ranked on the two Index scores and 
according to level of aspiration shown by each 
of the five tasks. Level of aspiration was de- 
fined operationally to be the difference between 
the first test performance and the goal set by 
the subject for his second test performance. 
Rank-order correlation coefficients for accept- 
ance-of-self scores and discrepancy scores of the 
Index of Adjustment and Values and the five 
measures of level of aspiration are given in 
Table 1. The data in Table 1 show that the 
two scores of the Index are not highly corre- 
lated with level of aspiration in the five meas- 
ures used. Only two of the correlations were 
significantly different from zero at the .05 
level or less. The correlation of discrepancy 
score and mark-out test was significantly dif- 
ferent from zero at the .05 level of confidence 
and the correlation of acceptance-of-self scores 
and Rotter board scores was significantly dif- 
ferent from zero at the .01 level. 


Table 1 


The Rank-Order Correlation Coefficients between the 
Index Scores and Level of Aspiration 
Shown by the Experimental Tasks 
aE AE aie Re 


Tasks Acceptance of Self Discrepancy 
Darts 18 —.24 
Rotter 518 -15 
Addition -08 -.07 
Substitution 13 -04 
Mark-out 01 -36* 


* Significantly different from zero at the .05 level. 
** Significantly different from zero at the .01 level. 


Intercorrelations of level-of-aspiration tasks. 
In order to compare levels of aspiration as 
shown by each of the five experimental tasks 
the rank orders for all of the tasks were inter- 
correlated. The intercorrelations are low but 
with the exception of the dart task, which did 
not correlate significantly with any of the other 
tasks, are significantly different from zero at 
the .05 level or less. The intercorrelations of 
the level-of-aspiration tasks appear to be higher 
than the correlations of the Index scores and 
the level-of-aspiration scores. The intercorre- 


lations of the level-of-aspiration tasks are con- 
tained in Table 2, j 
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Table 2 , 
Rank-Order Intercorrelations among the Five 
Experimental Tasks 


Substi- 
Rotter Addition tution Mark-out 

Darts -.01 -.08 .02 30 
Rotter 39% 39° ase 
Addition 49%% 3° 
Substitution 39 

* Significantly different from zero at the .05 level. 
** Significantly different from zero at the .01 level. 


Index scores and variability of level of as- 
piration. The distributions of levels of aspira- 
tion in the five tasks were converted into 
standard scores so that scores on the tasks 
would be comparable. This manipulation re- 
sulted in five distributions of standard Scores, 
one for each task. Each of these five distribu- 
tions was divided into two groups dependent 
upon the subject’s score (above or, below the 
mean) on acceptance of self on the Index of 
Adjustment and Values, and into two other 
groups according to discrepancy scores above 
and below the population mean on the Index. 
Variances of each of the pairs of distributions 
were compared by means of the F test. These 
tests show that on two of the five tasks, subjects 
with acceptance-of-self scores above the popu- 
lation mean of the Index were significantly 
more variable in the levels of aspiration they 
expressed than were subjects who had accept- 
ance-of-self scores below the mean. Likewise, 
subjects with discrepancy scores below the 
mean were more variable than subjects W!t! 


Table 3 n 
Variabilities of Levels of Aspiration when ee 
Are Divided According to Acceptance-of-Sel 
Scores on the Index of Adjustment 


and Values 
= uu 


Variance 
Acceptance Acceptance 
of Self of Self 
Above Below 
Mean* Mean p 
Task N=13 N=17 F 
N.S. 
Darts 1.188 1.414 oom NS. 
Rotter 913 1.036 a 0S 
Mark-out 1.612 653 pet ‘001 
Substitution 1.419 .196 a3 N.S. 
Addition 822 1190 L Aajustment 
* Acceptance-of-self scores on the Index Cfaation popu 


and Values above the mean of t! 
lation of the Index. 


ad 
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scores re 

— above the mean. Acceptance-of-self 

— on the Index and discrepancy scores, 
Correlated, yield coefficients around 


< “Wiese ee 
and 7 Uhese data are presented in Tables 3 


‘Table + 
Variabilities ; 
oe of Levels of Aspiration when Subjects 
oe reap According to Discrepancy Scores 
the Index of Adjustment and Values 


, Variance 
Discrepancy Discrepancy 
Below Above 
Task Mean® Mean 
N=16 N=14 F p 
Dart: 
Botte. 1.185 1400 1181 NS. 
Marko 1.722 331 5.202 01 
Salete s 1.068 914 1168 N.S. 
Pe 44783 1.061 2.220 N.S. 
ton 1.528 538 2,840 -05 


* Di 
iScrepg 
Values elon i Scores on the Index of Adjustment and 
the Index, e mean of the standardization population 


á 
m ea of self and estimate of perform- 
Performa jects were asked to estimate their 
they had nee on each of the tasks as soon as 
chi Sue a Pieted each task. A dichotomous 
ceptance-of aai? calculated using the mean ac- 
Population jeri score of the standardization 
and the ny ne Index to form one dichotomy 
Was Midera er of tasks in which performance 
The lee Ce as the other dichotomy. 
se uni dichotomy was formed by dividing 
Jects at ihe, of underestimates of all the sub- 
is olas median number of underestimates. 
inda all subjects with four or five 
and oan performances in one category 
a a with three, two, or one under- 
subje Performance in another category- 
Ormanee sts underestimated at least one per- 
© mean. Two subjects who were SPO 
Ur or ee acceptance of self underestimated 
Br suka performances as compared wit 
jects below the mean, while ten sub- 
who were above the mean on accept- 
Of self underestimated three, tw OF 
eee rmance as compared with eight 
Vieldeg elow the mean. This combination 
Nifican a chi square of 4.535 which is sig 
level tly different from zero at the £ 
stimate a may be interpreted to mean t : 
Nee of of performance is related to accep 
self. 


Acceptance of self and recall of performance. 
At the end of the experiment, following the 
reading of the excerpted paragraphs, each sub- 
ject was asked to recall his scores on each of 
the tasks. The number of overestimates, cor- 
rect estimates, and underestimates was calcu- 
lated for each subject and the subjects were 
divided into “overestimators” and “underesti- 
mators.” The one subject who had more cor- 
rect than faulty recalls was eliminated from 
consideration. These two groups formed one 
dichotomy of a double dichotomy. The other 
division was formed by dividing the subjects’ 
acceptance-of-self scores at the mean accept- 
ance-of-self score of the standardization popu- 


lation of the Index. 

Eight subjects with acceptance-of-self scores 
above the mean were classed as “overesti- 
mators” while only four subjects below the 
mean were included in this category. Four 
subjects with acceptance-of-self scores above 
the mean were included as “‘underestimators” 
but 13 subjects with scores below the mean 
were grouped in this division. This combina- 
tion produced a chi square of 5.396 which is 
he .05 level to show that recall 
related to acceptance of self. 

Acceptance of self and certainty of recall. 
Each subject was rated on the degree of cer- 
tainty for each of his five recalls. Subjects 
ided according to acceptance-of-self 
scores above and below the standardization 
mean and certainty of recall using the median 
of the averages for the 30 subjects as the divid- 
ing point. A double dichotomous chi square 
was calculated but was not significant. 

Acceptance of self and attitude toward per- 
formance. Each subject was asked to state how 
he felt about his performance in each of the 
tasks. Lists of the verbatim comments of the 


subjects were given to five judges who were 
asked to classify each statement.” The judges 
decided whether the attitude expressed in the 
statement was positive or negative and whether 
it was directed toward or away from self. In 
this way five judges rated five statements for 
each subject. The subjects were then cate- 
gorized according to the classification which 


appeared most frequently as negative-internal, 
2 The author wishes to express his thanks to Vir- 


ginia Parko, Thomas Sutherland, Travis Rawlings, 
and Glen E. Roberts’ who served as judges. 


interpreted at t 
of performance Is 


were div 
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negative-external, positive-internal, and posi- 
tive-external. A double dichotomous chi square 
was calculated using negative and positive at- 
titudes as one dichotomy and scores above and 
below the population mean on acceptance of 
self as the other dichotomy. One subject with 
an acceptance-of-self score above the mean ex- 
pressed a negative attitude toward his per- 
formance compared with 12 subjects below the 
mean, but 12 subjects with acceptance-of-self 
scores above the mean demonstrated positive 
attitudes while only 5 subjects below the mean 
showed positive attitudes. The chi square pro- 
duced by this combination was 11.868, which 
is significant at less than the .01 level. Thus, 
type of attitude expressed toward performance 
in the level-of-aspiration tasks is related to ac- 
ceptance of self. 


A chi square was calculated using acceptance 
of self as one dichotomy and direction of ex- 
pressed attitude as the other dichotomy. Eight 
subjects with acceptance-of-self scores above 
the population mean directed their attitudes 
about their performance toward themselves 
and 5 directed it away from themselves, while 
16 subjects below the mean directed their at- 
titudes toward themselves and 1 directed it 
away from himself. This chi square was equal 
to 4.887, which is significant at the .05 level, 
and shows that acceptance of self is related to 
the direction of expressed attitude. 


Discussion 


The intercorrelations of the Index and the 
experimental tasks. Eysenck has stated: 


The actual size of the correlation [between two 
levels-of-aspiration tasks] would appear to depend 
on three points: 


(1) The similarity of the two tests, as regards 
the ability measured. 


(2) Similarity of the scale on which goodness of 
performance is measured. 

(3) Similarity of the experimental situation, i.e., 
whether the two tests are given in the same 
experimental session or not [4, p. 133]. 


Studies with normal subjects have reported 
correlations between level of aspiration on dif- 
ferent tests ranging from .29 by Gould [7] 
to .70 by Frank [5] with an estimated median 
of .40 to .45. 


~ The iatercorrelations of the five tasks in- 
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cluded in the present study approximate the 
average of the reports in the literature and are 
about as high as might be expected when ex- 
amined in the light of Eysenck’s statement. The 
tasks were purposely selected to represent 4 
variety of motor and verbal performances, and 
only the last one of Eysenck’s three generaliza- 
tions was applicable to this experimental situa- 
tion, namely, that all of the experimental tasks 
were given in one session. 

The data show that the Index scores were 
not highly correlated with level of aspiration 
as measured by the five tasks, but the correla- 
tions approach the size of the interærtelat an 
among the five experimental tasks. Severa 
possible explanations of the low degree of in- 
tercorrelation between the tasks, and the cor- 
relations of the Index scores with the a 
appear tenable: (a) The Index is not a vali 
measure of level of aspiration. (b) Ego 1m- 
volvement in a task is an important variable 
in determining the usefulness of a task as 4 
measure of level of aspiration. (c) There may 
be more than one type of level of aspiration 
and each of the tasks and the Index may s 
measures of general and specific types of leve: 
of aspiration. (d) The level of aspiration as 
measured by the Index may be a more exact 
measure than the levels shown by the experi- 
mental tasks. These possibilities will be dis- 
cussed below. 

In regard to the first point, the Index of a 
justment and Values has not been validate: 
as a measure of level of aspiration, but exper?” 
mental tasks which are commonly used 38 
measures of this variable have not been valid- 
ated for this purpose either. It seems logic4 
to assume, however, that the discrepancy score 
of the Index is as valid a measure of level ie 
aspiration as the usual experimental tasks. T 
subject in filling out the Index is asked on ; 
items, after he has made a rating of his Peis 
status, to tell how he would like to be., pa 
process is equivalent to obtaining 49 nT 
of his level of aspiration. This is ae 
the same process by which level of asp!t@ 
is determined in experimental tasks. 

On the second point, several au 
11] have noted that the more a sud. the less 
a level-of-aspiration task as a- game, een this 
likely will be a high correlation — ot 
task and other measures. This may ™ 


thors [6, 
bject sees 
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is pi the extent of ego involvement in 
ion ds e mon valid the task will beas 
seems emin <i ioe eee The Index 
an ego-iny nie fitted to the requirements of 
a abel ve oe oe All of the ratings on 
and from es jee by the subject, on himself, 

n Soni n frame of reference. 
sonal level — to assume that the per- 
dents kouli ZSR TANIEN of female college stu- 
thus, it bec SPRA a large verbal factor, and 
ighest TE greater interest that the 
crepancy Baa a up discovered between dis- 
Present stu ‘i and level of aspiration 1n the 
test which ey was shown in the “mark-out 
the battery ae the most verbal task of 
of the fee che results indicate the possibility 
cept of self SeT of level of aspiration and con- 
level-of-aspi tis possible that the validity of 
deann an measures is at least partially 
ject, at ary the concept of self of the sub- 
Possibly mo of aspiration shown by a task is 
of Enae, highly related to personal level 
seen by tH n when performance in the task is 
PE seo as enhancing to self-or- 
tors in dete he importance of personal fac- 
emonstrat ape level of aspiration has been 

ie hird in numerous experiments. 

Settled in or and fourth points cannot he 
of further 1s paper, but are probably worthy 
Validation study involving factor analysis Ey 
ndex or ge external criteria. Would t e 
asks sh the usual type of level-of-aspiration 

i ow higher agreement with externa 


Criteria » ? 
la?” j s ‘ : 7 
P is a question which might be 1n 


“rigated profitably. 
tudieg ie and variability of performance: 
alues hay 3] of the Index of Adjustment an 

f-self g ave shown that the mean acceptance- 

Separat core of the standardization population 
erent i two groups which are distinctly a 

examina Personality characteristics. Rorschac 

Sete revealed that high scorers on mi 
ies ¢ e of self have more variable persona li- 

Present. low scorers, and the data from : e 
is study provide additional evidence = 

Where oclusion, In the two of the five n 
‘ie the difference in the varjability o T e 

en Was statistically significant, the ir 
e S constituted a more variable group than 

OW scorers. 

Mie ee self scores on 

tively and highly correlate 


the Index are 
d with discrep- 
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ancy scores [3]. When the variabilities of 
level-of-aspiration behavior of high and low 
scorers on discrepancy were compared, the low 
scorers were significantly morg variable on two 
of the tasks than were the high scorers. ‘These 
two tasks were not the same two which were 
significantly different when the division was 
made on the basis of acceptance of self, which 
may indicate that although the two Index 
scores are highly correlated, they are probably 
measures of different variables. 

The Index and ‘other observed behavior. 
The Index served as a better predictor of other 
behavior recorded in the experiment than it 
did for level of aspiration. Attitude toward 
self was shown to be related to attitude toward 
performance, direction of expressed attitude 
toward performance, estimate of performance, 
and recall of performance. These findings 
support the conclusion of other writers [10, 
12] that attitude toward self is an important 


determinant of behavior. 


Summary 
female subjects were test- 
ed with the Index of Adjustment and Values 
and five level-of-aspiration tasks. Subjects set 
levels of aspiration for each of the five tasks, 
estimated their performance in the tasks, ex- 
pressed comments regarding their performance, 
and after a filled interval attempted to recall 
their performances. 

It was concluded that Index scores were, 


to a low degree, related to level of aspiration, 


as measured by the experimental tasks, that the 
variability of the level of aspiration set by 


groups selected by the Index was significantly 
different, and that acceptance of self shown 
by the Index was significantly related to atti- 
tude toward performance, direction of ex- 
pressed attitude toward performance, estimate 
of performance, and recall of performance. 
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Directionality of Lines in the Bender-Gestalt Test 
Roland M. Peek 


Hastings State Hospital! 


Pop the use of the Bender-Gestalt test 
clinical pep theta has increased in both 
tional techni > meen ge settings, interpreta- 

ema heen ho with demonstrated validity 

-G Genie ey lacking. Interpretation of 
Y subjective s has for the most part been high- 
the skill os and consequently dependent upon 
examiners at of experience of individual 
interpretation on administration and manner of 
other Hegre nay Wary: widely from that of 

n most SEN dealing with other populations. 
al-experience t ns communication of the person- 
idity) is h type of skill (assuming its va- 
0 dl ee aN e and distorted by the lack 
escribe the T definitive terms with which to 
the stimulus pastor occurring in response to 

One of d iE ina 
B-G, = Nl first needs in the study of the 
ME system re ias been for some sort of scor- 
Variable į which would clearly define each 

n objective terms so that the scoring 


Would b 
ecome satisfactorily reliable, therefore 


Providj 

ing vari : , 
Periment, variables which were subject to ex- 
hough ation; the scoring must also be simple 
i ds of the 


culty w 


XCtio 
cho] n on a level which excludes much psy- 
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oth clinically and experimentally | J. 
d validating 


solution © 
that a par- 


Kis study was made at the VA Hospital An- 
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ticular aspect of B-G behavior seemed to be of » 
clinical significance, though not included in any 
scoring system previously published: the order 
and directionality used by the subject in draw- 
ing the parts of each figure. Such data can be 
included in a sheet containing general observa- 
tions of the subject's comments, handedness, 
attitude, etc. during the testing.? It has seemed 
apparent that deviations from popular modes 
of drawing the figures have psychological sig- 
nificance independently of the shape of the re- 
sulting drawing, and that this information 
combined with other variables increases the 
range of predictable extra-test behavior and the 


accuracy of such predictions. 


Problem 


ypothesis that variations from 
the usual approach reflect individual differ- 
ences in personality, comparison was made be- 
tween a control group and another group from 
the same population who drew the diagonal 
projection of Figure 5 ina specifically deviant 
way, i.e. starting at the top and drawing the 
dots in a series down to the half-circle, rather 
than extending the projection from the half- 
cle outwardly, as most subjects do. 


To test the h 


cir 
Subjects 
ntrol group consisted of 75 hospital- 
ychiatric patients random- 
ized by selecting every 20th discharged case in 
the files of a VA acute-treatment hospital. The 
75 cases in the experimental group, who came 
from the same section of the same hospital, 
were selected solely on the basis of having been 
reported to the author by any of six psychologi- 
cal trainees as having drawn the projection on 


2 The authors of the Peek-Quast scoring system 
for the B-G are greatly indebted to Dr. George S. 
nal suggestion that these adci- 


Welsh for the origi 
tional data may have potential clinical usefulness. 


The co! 


ized male neurops: 
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Figure 5 in the specified direction.* Since no 
investigation was made of the psychological 
testing of the controls, it is not known how 
many of that grcup drew Figure 5 as described. 


Procedure 


A check list was devised on which was tallied 
the information listed in Table 1. The source 
of the information was the brief final summary 
prepared by the physician when a patient was 
discharged from the hospital; because of its 
nature more comprehensive or more specific 
data were unfortunately not consistently 
enough noted to make worth while their in- 
clusion in the check list. A given category was 
checked if one of the specific words in each 
category was used when referring to the be- 
havior of the patient. The attributes were not 
tallied if described as deriving from the psy- 
chological testing without reference to overt 
behavior. The occurrences of each category 
were expressed in percentages; the statistical 
significance of the differences in percentages 
were determined by the use of phi coefficients 
as described by Jurgensen [4]. 


Table 1 
Items from Discharge Summary 
Included in Check List 


1. Diagnosis 
2. Treatment (EST, IST, Other) 
3. Prognosis 


(a) good (b) fair (c) guarded (d) poor 
4, Insight 

(a) good (b) fair (c) partial 

(d) poor (e) none 
5. Number of somatic complaints 

(a) none (b) one (c) two 

(d) three (e) four (f) five 


6. Number of somatic complaints 
(cumulative totals) 
(a) one or more (b) two or more 
(c) three or more (d) four or more (e) five 
or more 
7. Headache 
8. GI complaints 
9. Cardiac complaints 
10. Respiratory complaints 
11. Musculature involvement 
12. Weakness, dizziness 


3 Although subgroups were prepared on the basis 
of the direction of drawing the arc, and whether 
the projection was drawn first, the number of cases 
in each subgroup was too small at the time of the 
experiment to permit statistical analysis of the ap- 
parent differences between these subgroups. 
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13. Fatigue 

14. Anorexia 

15. Weight loss (as presenting complaint, not 
merely as a physical finding) 

16. Excessive perspiration (as a presenting Com- 
plaint) 

17. Dermatitis 

18. Buzzing or ringing in ears 

19. Other somatic complaints 

20. Depressed 

21. Suicidal thoughts or attempts 

22. Blackouts; amnesia 

23. Insomnia 

24. Tremulous 

25. Nervous, tense, restless, anxious 

26. Tense (tallied separately) 

27. Excessive drinking or addiction to drugs 

28. Incapacitated or adjudged incompetent 

29. Hallucinations or delusions 

30. Impotence; homosexuality 

31. Violent fears or dreams directed at patient 
(see text) 

32. Paranoid 

33. Seclusive 

34. Immature, dependent, inadequate, inferiority 
feelings, passive 

35. Impulsive, poor judgment 

36. Hostile, aggressive 

(a) readily expressed 
(b) poorly expressed 

37. Tearful 

38. Divorce, extreme marital or sexual problem 
(if evident in overt behavior) 


39. Parental deprivation or abnormality 
(death or separation of parents before age 12, 
or overt and severe problems such as being 
beaten regularly by a parent) 
40. Number of tallies in Somatic Complaint cate- 
gories plus items 34, 35, 36, 38 
(a) none (b) one (c) two (d) three oF 
less (e) six or more (f) seven or more 


Results 


Table 2 lists those categories for which the 
difference in percentages reached statistical s18- 
nificance at the .001, .01, .05, and .10 levels 
of confidence, the latter included only to a 
dicate the general trends running throug t 
data. 4 

No significant differences appear an 
the diagnoses of the two groups, neither 7e 
terms of specific diagnosis nor by broad ris 
chotic-nonpsychotic categories. No dieren = 
are apparent in treatment received nor 1n j 
degree of insight attained. However, the ae 
trol group shows a greater percentage W 
prognosis is described as “good.” 
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Table 2 
Items from Check List (see Table 1) 
Differentiating a Random Group of NP Patients 
from Patients Drawing Projection of B-G Fig. 5 
toward the Arc 


(N is 75 for each group) 


Item Controls Exp. Item Controls Exp. 
% Ge % % 


Significant at .001 Level Significant at.01 Level 


5(a) 32 5 6(e) 7 24 
6(b) 45 83 7 I6 37 
6(c) 25 63 10 $ i$ 
6(d) 19° 4 31 52 
20 316315 1 12 
34 25 55 22 4 19 
36 25 52 31 0 oN 
37 3 2135 11 31 
H (d) 69 23 39 17 36 
H (e) 5 37 40(a) 9 0 
+f) 3 23 40(b) 17 3 
Significant at .05 Level Significant at .10 Level 
3(a) 13 3 3(a)-+3(b) 32 20 
5(d) 7 19 3(o)+3(d) 68 80 
5(f) 3 13 4(a) 1o 4 
(a) 68 85  5(b) 23 12 
ut 9 21 5(e) 20 33 
19 21 37 8 23 36 
21 3 ë 27 12 16 27 
36 (a) 23 4 2% 37 51 
Tola 21 8 28 16 27 
Sa) o 


platting differences are noted in the com- 
~ nts listed in the final discharge summary. 
‘on group is more likely to have jo 
e complaints at all, while paa 
Rreater group begins to show a signi SaN ; 
t an number as the somatic complaints + 
A a above, Using cumulative totals, the 
r o group is more likely to have one 
More € two or more, three or more, four or 
» and five or more somatic complaints. 

ifference appears not only in number but 
types of somatic complaints. A signifi- 
8reater proportion in the experimental 
Pp has headaches, respiratory ailments, 
“ints involving the musculature, severe 
om anorexia, and “other somatic COM» 


In the 
Cantly 
Brou 


by 2 pete characteristics and complaints noted 
Oeu Psychiatrists significant differences also 
€ patients who draw the diagonal of 
oward the half-circle are more often 
zed as immature, passive, inadequate, 


done St 


acter; 
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or dependent, and more often exhibit hostile or 
aggressive behavior. It is interesting to note 
that the patients in the control group who ex- 
hibit hostility are more likely to be capable of 
direct expression. More evidence for the ap- 
parent inability of the experimental group to 
face directly the source of their frustrations is 
seen in the fact that they show a significantly 
greater incidence of blackouts or amnesia. The 
affect of this group also seems more seriously 
disturbed, as seen in the greater frequencies of 
depression, tearfulness, and suicidal thoughts 
or attempts. That frustrations may always 
have been present for these people is suggested 
by the finding that serious deficit or abnormali- 
ty in the home situation during formative years 
is mentioned with significantly greater fre- 
quency in the experimental group. 

Differences appear also in the fears and 
dreams which reach sufficient intensity as to be 
included in the discharge summary. These 
fears or dreams all seem to represent forces of 
a violent nature impinging upon the patient, 
as illustrated by the following typical state- 
ments: “people planned to shoot him,” “he felt 
there were guns pointing at him in the dark,” 
“dreams of sharks,” “soldiers coming at him,” 
“feeling of a gun being discharged into his 
abdomen,” etc. 

As a very crude measure of the over-all ex- 
tent of involvement, a summation was made 
of the number of complaints and the listed per- 
sonality traits. It was found that the control 
group was more likely to have zero, only one, 
only two, or three or less such tallies, while 
the experimental group was much more likely 
to have six or more or seven or more tallies, 


Discussion 


It appears from the above experiment that 
differences in personality and even in certain 
personal-history items are reflected in the man- 
ner in which the subject draws the component 


arts of a Bender-Gestalt figure. It is especial- 
ant that this should be true even 
ific behavior on a single B-G 


figure (independently of quality of the per- 
oe is correlated with a criterion as 
brief and variable in its coverage of data as a 
ri 


‘scharge summary. i 
<7 “old be pointed out, however, that al- 


though statistically significant differences oc- 


p Er 
ly signific 


when a very spec 
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cur, many of these variables show a large 
enough incidence in both groups as to reduce 
the practical importance of such variables. It 
may be more useful, therefore, to consider a 
syndrome or combination of attributes by 
which to differentiate various groups. On the 
basis of this experiment such a behavior pat- 
tern might be postulated for patients drawing 
Figure 5 as described. In general, these pa- 
tients appear immature and dependent, to have 
somewhat less capacity for adjustment than 
their ward-mates. They are prone to feel over- 
whelmed by their problems and to be easily 
frustrated. Direct attack upon the sources of 
this frustration seems too threatening; other 
less adaptive mechanisms are resorted to, such 
as blackouts, amnesia, and the many self- 
punishing somatic reactions. The frustrations 
experienced as a result of their inadequacy may 
lead to hostile and aggressive expression, which 
is more likely to be indirect or poorly con- 
trolled. The ineffectiveness may appear insur- 
mountable so that there occurs a greater fre- 
quency of depression, tearfulness, and even 
suicide. Mention has already been made of the 
greater percentage of “good” prognoses in the 
control group. Though significant only at the 
-10 level, it is noted that there is a greater 
tendency for the patients within this syndrome 
to be completely incapacitated or to have been 
judged incompetent by a court. As pointed 
out earlier, the larger proportion of grossly un- 
favorable factors in the home environment is 
suggestive in the consideration of etiological 
elements. 

For those clinicians interested in the sym- 
bolic value of the B-G figures, the statement 
might be made that the direction in which the 
Projection in Figure 5 is drawn may represent 
the impinging forces within the patient’s en- 
vironment, which are perceived as overwhelm- 
ing and punishing, as contrasted with other pa- 
tients whose attack is directed outwardly (the 
same direction in which they draw the pro- 
jection on Figure 5) against their problems. 

What defenses are utilized in the individual 
case cannot be determined by knowledge of 
this one relatively minor aspect of B-G be- 
havior but are dependent upon other findings 
on the test. It is hoped that research now in 


Roland M. Peek 


progress using a configural approach with ob- 
jectively scored factors may increase the use- 
fulness of the B-G as a clinical and experimen- 
tal instrument. This experiment seems to 1n- 
dicate that the order in which lines are drawn 
and the directionality of such lines should be 
included in B-G scoring systems. 


Summary 


Comparison was made between 75 random- 
ly selected neuropsychiatric patients and 75 pa- 
tients from the same population who were 
known to have drawn the diagonal projection 
on Figure 5 of the B-G toward the inverted 
half-circle of dots, rather than in the popular 
manner, i.e., outwardly from the half-circle. 
Overt behavior and traits of the patient and 
certain personal-history items as described in 
the discharge summary were the variables com- 
pared in the two groups. The significance of 
the differences of percentages of occurrence of 
each attribute were tested using phi coefficients. 
Twenty-seven variables were found to have 
differences significant beyond the .01 level of 
confidence, while nine variables were signifi- 
cant at the .05 level. On the basis of these 
findings it was suggested that the order and 
directionality used in drawing parts of the B- 
G figures be included in data derived by test- 
ing with that instrument. 
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Test-Retest Stability of MMPI Scales for a Psy- 
chiatric Population” 


Albert Rosen 
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Nioben of reliability of personality tests 
in the fields. per which are not present 
testing, Reliab intelligence and achievement 
measurement , ility defined as accuracy of 
error of meas ji in terms of a low standard 
quately ee cannot be evaluated ade- 
tency ee ee tests. Internal consis- 
ate for Bellen. of reliability are not appropri- 
Some ny ues such as those in the MMPI [1]. 

hese scales demonstrate considerable 


Inhom $ 
o , 
with geneity, for they were not constructed 


es been some question as to whether 
Sonality tg of reliability is desirable in per- 
Sument th s [3]. According to this latter ar- 
8 anges in n individ of a personality scale to 
therapy, ig aa individual, say, through psycho- 
ty Tin in much more important than reliabil- 
on the ntelligenee and achievement testing, 

Other hand, the ideal test is one which 
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Sensitivity would be evaluated by the lack of 
consistency of scores after a period of time, 
following some change which had occurred in 
the individual as a result of psychiatric therapy 
or gross environmental alteration. Both of 
these conditions are desirable features of a 
personality scale. A score for an individual on 
any scale at a given time should be within a 
reasonable distance of his “true” score. On the 
other hand, the scale should have the capacity 
for reflecting modifications in personality with 
the advent of radical change in environmental 


status. 
The purposes of the present study were (a) 


to measure the stability of the individual 
MMPI scales for a psychiatric population over 
a brief test-retest interval by means of product- 
moment correlation coefficients, and (d) to 
evaluate what changes occur in patients’ 
MMPI scores as a result of hospitalization 
and participation in the hospital regime for a 
few days before they have received much, if 


any, therapy of a formal nature. 


Selection of Subjects 


Every new, testable patient who was admit- 
ted to the psychiatric section of the Minne- 
apolis VA Hospital during an eight-week peri- 
od was given the MMPI. All patients are 
males. Retesting was done within two to seven 
days until forty test-retest cases were obtained. 
It was decided beforehand to exclude from the 


the following cases: 


retested more than seven days after 
he seven-day limit was arbitrarily 
duce the effects of psychotherapy 


sample 


1. Patients 
the initial test. T] 
set in order to re 


on scores. 
2. Former patients. Each of these patients had 


had one or more tests during one or more previous 
admissions. It was anticipated that sufficient re- 
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sistance, to retesting would be encountered in these 
patients to provide an inadequate measure of sta- 
bility. 

3. Soldiers. Men in active service, when admiited 
to the hospital, often possess strong motivation to 
take the test in such a way as to give a very poor 
psychiatric picture, with the hope of obtaining dis- 
charge from the service. 

4, Patients given the group form of the MMPI 
as the initial test, It was decided to restrict the 
study to patients who had taken the individual 
(card) form because of any differences which might 
occur as the result of the patient taking two some- 
what different tests. 


Of the 89 patients admitted to the hospital 
during the eight-week period, the records of 
49 cases could not be used in the study because 
of the four reasons described above, or be- 
cause a test and retest were not available. The 
reasons that these 49 cases were excluded are 
classified below, with the number of cases indi- 
cated for each category. 

1. Initial test unavailable (12): (a) In Psychi- 
atry too brief a period to be tested (5), (b) Too 
disturbed to take test (5), (c) Received electroshock 
therapy almost immediately (2). 

2. Retest MMPI unavailable (37): (a) Former 
patients (14), (b) Initial MMPI given more than 
one week prior to admission to Psychiatry (6), (c) 
Not retested within a week of the initial test (4), 
(d) Group form administered as initial test (3), 
(e) Soldier (2), (f) Electroshock therapy given 
before retest (2), (g) Refused retest (2), (A) Too 
disturbed for retest (2), (i) Left Psychiatry before 
retest (2). 


Procedure for Administration of Tests 
and Retests 


Each patient was individually administered 
the initial test within a few days after admis- 
sion by the psychologist on the psychiatric 
team to which the patient was assigned. Thus, 
only a few cases were given the initial test by 
the writer. Retesting was done within two to 
seven days by the writer. In most cases the 
retest was given individually, but in approxi- 
mately eight cases the patients were seen in 
pairs, and one group of five patients was tested 
at a time. 

Each patient was given the same rationale 
for the retesting, although no attempt was 
made to word it exactly in the same way. Each 
Patient was told, in effect, that the retest 
would be of value to the staff and the patient 
in affording a dual base line for comparison 
with any later psychological evaluations which 
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might be desired for assessing the patient’s 
status. However, the patient was told to an- 
swer the items as he felt at the time. The latter 
instruction was designed to counteract any be- 
lief on the patient’s part that he might be ex- 
pected to duplicate his initial test responses. 


Table 1 


Test-Retest Time Intervals for the 40 Patients in 
the Stability Study 


Number of Days from— 


First 
Admission to test to Admission to 
first test second test second test 
Q, 1:3 3.1 5.5 
Md 2.8 3.9 7.0 
Q; 5.2 48 9.8 
M 3.6 4.1 FT 
Range 0-12 2-7 2-19 


In Table 1 are shown the summary statistics 
on the number of days from (a) date of hos- 
pital admission to initial test, (b) initial test 
to retest, and (c) hospital admission to retest. 
The Christmas vacation period intervened dur- 
ing this study, so that some of the patients 
were seen for initial testing later than woul 
normally occur. Four patients took the first 
test more than seven days after admission. On 
the average, however, patients were teste 
within three days of admission and reteste 
within four days. No patient was retest¢ 
within forty-eight hours following the initi 
test in order to avoid contaminating the 1e- 
sults with a memory factor. 


Description of Patients in the Stability Study 

According to primary psychiatric diagnos 
the sample was comprised as shown in Table 
2. Data were also recorded on each patient 
for age, occupational level, years of forma 
education, marital status, and intelligence 
Medians for the group are as follows: Age— 
32.4 years; education—11.2 years; pee 
tional level—4.4.2 Of the total group, 32.970 
had never been married, and 53.8% oe 
an equivalent Wechsler-Bellevue IQ of 1100 
higher, as determined from Shipley-H ‘ 
test results. The stability sample demonstrate’ 


oe 4 vari- 
no significant difference on any of these j 
. ar” 
3The occupational rating scale devised A w 
ner, Meeker, and Eells [4] classifies occupa 


levels 1 (the highest) through 7. 
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: Table 2 
Primary Diagnoses of the Patients in the MMPI 
Test—Retest Sample 


Number Per cent 
Diagnosis in of 
Sample Sample 
Anxiety reaction 12 30.0 
Conversion reaction 3 FS 
Depressive reaction 9 22.5 
Somatization reaction 1 2.5 
Neurosis total 25 62.5 
Bin wey . . z 
Paranoid schizophrenia 5 12.5 
Schizophrer ia, unclassified 3 7.5 
Paranoid state 2 5.0 
Involutional melancholia 1 2.5 
Psychosis total Ti 27.5 
Inadequate personality 1 2.5 
Alcoholism 2 5.0 
Convulsive disorder 1 2.5 
Other diagnosis total 4 10.0 
All cases 40 100.0 


ables, nor on diagnosis, when compared with a 
sample of 250 patients-in-general. This latter 
group represents a cross section of all patients 
at the same hospital over a two-year period 
who had taken the MMPI. Therefore, results 
obtained in this study are most likely repre- 
Sentative of the patient population. 


Test-Retest Stability Coefficients 


For each of the scales, a product-moment 
Correlation coefficient was computed from the 
test and retest records of the 40 patients 1n 
the stability sample. There has been only one 
ee study, that of Holzberg and Alessi [2], 
n Which the stability of the MMPI scales was 
ee ee for a psychiatric group over 4 brief 

'st-retest period. However, that investigation 


‘fered from the present one in the following 
Ways: 


en One-half of their total group of 30 cases. w 
test, re rie complete test of 550 items as the asec 
on » and were retested within one or two days ba 
Seal the 350 items which are scored in the origina 
es, 
2. 
The other 15 cases re 


Shor 

r i s 
i t form in reverse order wit 
nterva] 


ceived the long and 
hin the same time 


Exactly two-thirds of their cases were psy- 


Choties as compared to oily 27.5% in the present 


Study, 
+ Their sample apparently consisted of state hos- 


Pit : 
al psychiatric patients of both sexes. 


The product-moment stability coefficients of 
the two studies are shown in Table 3. The 
coefficients from the two studies generally cor- 
respond except on L, F, Hs, aad Pd. Perhaps 
the coefficients for L and F are lower in the 
present study because of the reduced effect of 
the memory factor over the longer test-retest 
interval. Any other divergence in the results 
for the two studies may be due to the differ- 
ences in diagnostic composition of the two 
samples. The MMPI scale scores of the Holz- 
berg and Alessi sample of state hospital pa- 


Table 3 
Test-Retest Stability Coefficients for MMPI Scales 
Present Holzberg & 
Scale Study Alessi [2] 
(N= 40) (N= 30) 
ee 
L -62 85 
F RI .93 
K .65 
Hs .85 .67 
Hs +.5K 86 
D 80 80 
Hy 88 87 
Pd 88 52 
Pd+ 4K 87 
Mf 64 .76 
Pa .75 78 
Pt 80 372 
Pi +1.0K 88 
Se 83 89 
Sc + 10K -86 
Ma 56 58 
Ma+ 2K 55 
Si .83 
Note—Coefficients of .81 and .86 are significantly dif- 
ferent from zero at the .05 level, for N of 40 and 30, 
respectively. 


tients are all considerably lower than those 
found for the veterans in the present study. 
The latter are no doubt suffering from com- 


paratively acute rather than chronic mental 


disorders. 
In the present study, the coefficients for L 


and F no doubt underestimate the degree of 
relationship between the test and retest rec- 
ords, because of the positive skewness in the 
L and F distributions of scores. On the clinical 
scales, the correlation coefficients range from 
55 to .88. All the correlations of the clinical 
scales in common use are equal to or above .80, 


except Pa and Ma + .2K. The MMPI scales, 
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Pa Pt Sc Ma 
Hy +.4K Mr Pa 


41K +1K +.2K Sj 


40 
30 


Fig. 1. Mean MMPI T-score profiles for the first and second tests (N = 40). 


in general, demonstrate a fairly high degree of 
stability in an absolute sense, and a high de- 
gree of stability relative to what one would 
anticipate in personality scales. 

It is important to consider the factors which 
may have influenced the degree of consistency 
obtained in this study. The following condi- 
tions of administration were not uniform for 
initial test and retest, and would tend to re- 
duce stability. 


1. Variations in motivation from test to retest. 
Some of the patients took the second test somewhat 
reluctantly because they were not strongly convinced 
that it would be of any additional value. 

2. Individual administration of first test and 
group administration of retest for some cases. 


3, Administration of test and retest by different 
examiners, 


On the other hand, the second test was given 
within two to seven days of the first, so that 
memory for some of the items may have con- 
tributed in the direction of enhancement of 
stability. It is difficult to determine how much 
weight can be assigned to each of these condi- 
tions. The first is by far the most important 
factor. Probably the total effect was to some- 
what underestimate stability. 


“ Changes in Means from Test to Retest 


Clinicians often speculate about what chang- 


es occur in patients merely as a result of hos- 
pitalization and participation in the hospital 
regime for a few days before they have received 
much, if any, formal therapy. The data from 
this sample provide this information, as it is 


measured by the MMPI. Table 4 presents the 


Table 4 


Differences in Raw Score Means on MMPI Scales 
from Test to Retest (N = 40) 


Standard 
Mean Deviation 
Scale First Differ- First 

Test Retest ence Test Retest 
v6 4.05 4.35 30 217 209 
F 7.78 748 -30 512 475 
K 13.08 14.58  1.50* 4.08 4.69 
Hs 13.00 11.90 -1.10 6.25 Kee 
Hs + 5K 1982 19.45 =37 6.25 eC 
D 29.20 29.55 «356.27 ee 
Hy 28.50 27.62 -88 6.38 ee 
Pd 21.50 20.45 1.05" 5.49 ao 
Pd+ AK 2665 26.28 -37 486 Jy 
Mf 25.48 24.75 -73 420 ot 
Pa 13.00 11.92 -1.08* 439 Oe, 
Pt 23.12 21.02 -2.10* 9.45 3.05 
Pt+10K 36.20 35.50 70 798 5go 
Sc 21.40 18.95 -245* 10.94 3'49 
Sc+10K 3448 3343 -1.05 949 <28 
Ma 17.88 18.35 47 430 490 
Ma+.2K 20.52 21.25 73 3.87 1108 

Si 34.48 33.25 1.23 11.00 © - 


*Difference significant at the .05 level. 


Test-Retest Stability of the MMPI Scales 


differences in raw score means for the 40 pa- 
tients in the stability study who were, on the 
average, tested within three days of admission 
to the hospital and retested four days after the 
first test. Figure 1 portrays the test and retest 
mean T-score profiles based on the raw scores 
in Table 4, 

There are five significant differences in 
means from the first test to the retest. The in- 
Crease in K score and the decrease in Pd, Pa, 
Pt, and Sc point to a movement in the “nor- 
mal” direction with an improvement in de- 
fensive structure. After a few days of hospi- 
talization, there is a general over-all decrease 
in MMPI scores for the group as a whole. 


Summary 


LA group of 40 male, veteran, psychiatric 
hospita] patients were administered the indi- 
vidual form of the MMPI on an average of 
i ree days after admission to the hospital and 
28ain on an average of four days after the ini- 
tial test, 

2. For clinical scales in common use, test- 
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retest stability coefficients are almost all be- 
tween .80 and .88. 

3. There is an over-all tendency for reduc- 
tion in MMPI scale scores and increase in de- 
fensiveness during the first few days of hospi- 
talization before much, if any, formal therapy 
has been initiated. 


Received September 22, 1952. 
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Perceptual Learning and Age 


Bernard Hanes * 
Ohio State Penitentiary 


Gilbert [1] demonstrated that relationships 
between learning and age are probably a func- 
tion of the method of presentation and meas- 
urement. After matching old and young in- 
dividuals on a vocabulary test he concluded 
that the least amount of deficit occurs in the 
immediate recall of brief new material; the 
greatest deficit occurs in the recall, after brief 
exposure, of more complex material. 

Gilbert’s study also demonstrated that mem- 
ory involving the formation of new associa- 
tions was extremely difficult for senescents, 
thus pointing to a relative intellectual inflexi- 
bility for this age group. 

Halstead [2] approximated the same con- 
clusions in his study of seniles aged 69 through 
83. These old people were best at rote mem- 
ory, immediate visual recognition, and doing 
tasks involving early acquired habit patterns. 
Remembering or learning involving the re- 
versal of old habits was considered to be poor. 

Ruch’s [3] work assumes that later maturi- 
ty should bring a differential set of changes in 
rate of learning. He discovered that older in- 
dividuals were relatively more handicapped if 
the new learning required the attachment of 
an antagonistic response to a previously learned 
S-R connection than if the response was con- 
sonant with past experience. Relatively mean- 
ingless responses stood intermediate in difficulty 
of learning between the consonant and the dis- 
sonant material. His measure of the effects 
of the type of material was in terms of ability 
to form S-R connections. He used, of course, 
a critical score as his measure of performance. 

It seems entirely possible that this learning 
deficiency is in part due to errors in perception 
of the material when it is presented. This 
deficiency might be more marked for the dis- 
sonant than for the consonant material and, 


1 Now in Dallas, Texas. 


in turn, more marked for the older than for 
the younger groups. 


Exposure Materials Used 


In order to obtain a clearer view of this 
problem, a task consisting of tachistoscopically 
presented material was chosen for its relation- 
ship to the past experience of the subjects. The 
task consisted of three types of material. 


Type A: This is considered as highly stable, un- 
ambiguous material, essentially agreeing with past 
experience, “true material,” as follows: 10 X 7 = 
20, 123 = 7 16, 1K 12: 12; 16 3 3 48, 
EX = 72,13 —2= 11, 12 X 5 = 60, 11 X 
9 = 99,15 — 5 = 10, and 21 — 2 = 19. 

Type B: This material is considered as nonstable, 
requiring a reversal of past habit associations, and 
is essentially contrary to past experience, “false ma- 
terial,” as follows: 20 X 4 = 10,9 X 12 = 90, 
18 — 9 = 11,9 X 14= 36, 20 — 5 = 19, 33 — 
7 = 24, 12 X 0 = 12,4 X 12 = 49, 32 — 32 = 
1, and 55 — 5 = 49. 

Type C: This material is considered lowgrade, 
rather nonsensical information, requiring new as- 
sociations, and is essentially nonsense, as follows: 
I4 $3122) s 17 = 9, 5 : 15 = 62, 19 : 49 = 
7, 22 : 18 = 7, 8 : 31 = 53, 23 : 5 = 17, 32 : 19 
= 6, 54 : 1 = 85, and 29 : 6 = 53. 


Hypotheses Tested 


The hypotheses tested were: (a) Highly 
stable, unambiguous information should be 
relatively intact in later maturity. (4) Non- 
sense material which calls for new associations 
should show an intermediate decline in ol 
age. (c) Information contrary to past experi- 
ence should show the greatest decline in later 
maturity. 


Description of the Subjects 


One hundred and eighty white, recent af- 
rivals at the Ohio State Penitentiary were eac 
individually told that they composed a pa 
of a special group of high-caliber men, an 
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Perceptual Learning and Age 


that we wi 
Sther Simei to compare them on a test with 
chotic and es. These subjects were not psy- 
Mema mal scores on the Minnesota 
scores on the ee Inventory. Their IQ 
rom 91 to Co Beta examination ranged 
Would do Hes A he subjects all agreed they 
Were quite a J est on the test; in fact, they 
Although ake to get started. l 
€ criteria of 5 possible to state theoretically 
means of me unctional old age [+], exact 
Yet, been de suning these criteria have not, as 
It was deenen pëd, Therefore, in this study 
ed appropriate to use donolar 


age 

as the criter 

; crite 

cordingly rite eva of the aging process. Ac- 
Y, the following terms were used in 


this study: 
esignate AG “Young Group” was used to 
age. (IT) age period from 20 to 34 years 
Used to des: Middle Maturity Group” was 
rough — the age period from 35 
maturity” or on of age, and (III) “Later 
ate the age peri Id Group” was used to desig- 
these se from 50 to 70 years of age. 
a ð an. was composed of 60 in- 
normal vis, mately average intelligence 

ual acuity. 


Exper} 

Tachisto Xperimental Design 

. achistoscopi 

of ; dex b exposures of thirty 3” X 5” 
°rmation = containing the various types 

bug n ed. The an above were randomly 

Stitutey € Dumb apasare time was 1/10 sec- 

ted the Sore. of correct perceptions con- 

ubject; 3 

Was S groups Ppa assigned to each of the 

u a ize n s described above. Group I 
n a control group, while Groups 


lxt 
Vario Y s 


Bro I 
Saai ip w oe 
Int “5 The aie, utilized as experimental 
the p € testin jects were individually called 
Song; Cnshow ta aa and seated in front ©: 
Cach Sted of feck lstoscope. The practice trials 
follan the oe exposure of one of 
ject, 8 instru lous kinds of material. The 
` ctions were given to each sub- 
Mene is 
Nt a ta . 2 
Here c U See ty bo which you look into the instru- 
Š nt of you, like this [demonstrate]. 


Me: S some ; 
thi e id 
Q ti idea i 
ards] S lik of what to expect. ay see 
an Jio e this pect, Xou may 

Othe. T You may’ [show one of the practice 
Practice ikai something like this [show 
th ough tS, go ah ]. If you aren’t quite sure ° 
ù x the regula ead and guess. Before running 
actice cuk test cards, I will let you have 

s. [After each practice card ad 
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hs, g , } 
been flashed’ the subject was shown exactly what 
information was contained on the card.] You have 
now finished the practice test. Do your best, and tell 
3 st, a 


me exactly what you see. 
: 
Statistical Analysis of Results 
The results were submitted to an analysis 


Table 1 
Analysis of Variances 
Source of Mean 
variation df square F 
Group I 
Between types of 
material 2 389.73 125.31 
Between people 59 7.92 2.55 
Residual (error) 118 3.17 
Group II 
Between types of 
material 2 441.76 158.34 
Between people 59 6.96 2.49 
Residual (error) 118 2.79 
Group II 
Between types of 
material 2 408.10 124.04 
Between people 59 8.03 2.44 
118 3.29 


Residual (error) 


of variance. All the 
significant. However, 1n 


where these significant f 
means, standard deviations, and ż ratios of the 


various data were computed, and are shown 
in Table 2. The means of the various groups 
for each kind of material are shown graphically 


in Figure 1. 


F ratios in Table 1 are 
order to determine 
differences lie, the 


Table 2 
Means SD and £ Ratios for the Various 
; Materials 
3 Differ- t 
e M SD ences ratios 
III 
A 7.00 2,08 A-B 10.74 
B 2837 219 A-C 13.90 
Cc 2.34 2.19 B-C 3.76 
II 
A 8.17 1.76 A-B 10.40 
B 4.40 2.00 A-C 11.71 
2.90 2.28 B-C 1.28* 
I 
A 8.52 1.64 A-B 27.94 
B 4.58 2.34 A-C 32.08 
E 3.58 2.49 B-C 2.23 
* Nonsignificant at 5% level of confidence. 
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NuMBER CORRECT 


Bernard Hanes 


between kinds of material and age. The slopes 
of the various regression lines are practically 
identical and slight variations from parallel 
are treated as error. Thus, the study shows 
a relationship between performance and age, 
with all three groups experiencing greater dif- 
ficulty in learning the nonsense material. Ap- 
parently then, materials requiring the reversal 
of old habits show a substantially greater deficit 
in the aged, but the greatest deficit is mani- 
fested in materials calling for the learning of 
new associations. Hypotheses (b) and (c) are 
untenable. 


Table 3 


t Scores between Groups on Various Conditions 


AGE GeouPs 


Fig. 1: Comparison of the three types of mater- 
ials in each age group. 


Discussion 


The analysis of variances reveals a real dif- 
ference between types of material exposed and 
between individuals within each age group. 

An interaction is probably demonstrated by 
the nonsignificant ¢ ratio of 1.32 on material 
C, between Groups III and II. Perhaps this 
interaction pertains to a relaxation process tak- 
ing effect in the ages after 35. 

Judging from Figure 1, a deficit following 
a definite straight line from young to old oc- 
curs in material C. The dotted lines, con- 
structed by the least-square method, show the 
deficit that should occur on materials B and C. 
The line for material C is, of course, identical 
with the least-square line of best fit. 

The amount of retardation in deficit in ma- 
terials 4 and B is theoretically demonstrated 
by the vertical space between the dotted and 
solid lines. Evidently, the largest deviation of 
materials Æ and B from the general trend oc- 
curs in the middle age group and grows im- 
preceptibly less as the extreme ages are ap- 
proached. 


No particular relationship is demonstrated 


t ratios under Condition 


Groups A B c 
I-II 3.26 3.92 1.32" 
III-I 4.27 4.16 2.82 
II -I 1.11* aan 1.56% 


*Nonsignificant at 5% level of confidence. 


Conclusions : 

Decline appears to be most apparent 10 
learning requiring new associations, rather 
than learning which demands a reorganization 
of previously formed habit patterns. No evt- 
dence for any relationship between kinds of 
material and decline was found; but, rather 4 
consistent relationship between age and per- 
formance was discovered. The younger Pe 
son performs better, but experiences approx” 
mately the same difficulty with the various 
types of materials as the older person. 


Received October 8, 1952 
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Wechsler-Bellevue Split-Half Subtest Reliabilities: 
Differences in Age and Mental Status’ 
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Considering the extent to which the Wech- 
sler-Bellevue test [13] is used and the various 
groups to which the test is administered, the 
number of studies investigating the reliability 
of the test is limited [10]. Derner, Aborn, 
and Canter [2], and Webb and De Haan 
pa have examined “normal” subjects, while 

thers [4, 5, 8, 9] have utilized psychiatric 
subjects. Webb and De Haan, who investi- 
gated subtest reliability in a paranoid schizo- 
Phrenic group as well as in a “normal” one, 
rs eam yg [4], who investigated the re- 
aaa fen, of only 4 verbal subtests, computed 
od om of reliability by the split-half meth- 
abili he other investigators computed reli- 

‘ty by the retest method. 

a and Guertin [10] reported that the 
ité les utilizing psychiatric subjects are too 
g onclusive because the retest reliabilities were 
onfounded with clinical changes and with 
ina efiects, It was for this reason, plus 
7 fact that the Wechsler-Bellevue test 1$ 
Sually administered in one test period, that 
jo and De Haan believed it important to 

Pute reliability by the split-half method. 
split pe and De Haan [12] reported higher 
ae half reliability coefficients in the perform- 

Ce subtests for their paranoid schizophrenic 


T 
only. than for their “normal” group, although 
Wi Y one difference between the coefficients 
y t level and one 


S signific he 1 per cen 

at the ant at the 1 p + 1 [6] pointed 
. Helmick [6] po 

per cent level f reliability co- 


x : 
the The criticism and assistance of N. W: Shock 1n 
leq? EParation of this report is gratefully ack w- 
Om, Mrs, E. Benser gave valuable aid in 

Putational work. 


Sut A 
that since the magnitudes © 


225 


efficients are dependent upon the variability in 
the groups, the conclusions reached by Webb 
and De Haan were unwarranted. He recalcu- 
lated the data of Webb and De Haan and 
found that when the respective variabilities 
were allowed for, the magnitudes of the reli- 
ability coefficients were about the same for the 
paranoid schizophrenic and the “normal” 
groups. ” 

The present study was designed to extend 
our knowledge of Wechsler-Bellevue split-half 


reliabilities. 
Procedure 


Comparison was made between the subtest 
reliabilities computed by Webb and De Haan 
for a “normal” group [12] with the subtest 
reliabilities of a “normal” but older group. In 
addition, comparison was made between sub- 
test reliabilities of the older “normal” group 
and those of a matched group comprised of 
hospitalized patients diagnosed as “senile psy- 


chosis” and “psychosis with cerebral arterio- 


sclerosis.” 

Subjects of the older “normal” group were 
originally examined for the purpose of another 
study by Fox and Birren [3]. The mean age 
of this sample population was 64.3 years, o = 
3,19, and the mean age of the sample popula- 
tion of Webb and De Haan [12] was 37.6 
s e= 11.20. The former group will 
henceforth be referred to as the “old control” 
and the latter as the “young control.” The 
mean 1Q of the old control group was 100.8, 
o= 11.4, and of the young control, mean IQ 
= 97.8, o = 11.07. Both groups consisted of 
50 white subjects who were apparently free 


year: 
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of aberrant mental conditions. The only de- 
terminable difference between these two 
groups, in addition to the above, was a sex 
difference. The young control group consisted 
of women whereas the old control included 
both men and women. The hospitalized group 
that was compared with the old control group 
was originally examined for the purpose of a 
validity study [1]. It was indicated that the 
old control group and the hospitalized group 
were comparable except for mental status. The 
hospitalized group will be referred to as the 
“senile group.” It included 31 male and fe- 
male subjects. 

The method of Webb and De Haan was 
used for estimating the reliability coefficients. 
The scores on odd versus even items of the 
subtests were correlated and reliability was 
estimated by the Spearman-Brown formula 
for double length of test. The reliability of 
the Digit Span subtest was determined by cor- 
relating Digits Forward and Digits Backward 
instead of correlating odd versus even items. 
The reliability coefficient of the Object As- 
sembly subtest was estimated by intercorre- 
lating the three items, transforming the inter- 
correlations to z values, and retransforming 
the mean z value to the correlation coefficient. 
The reliability coefficient was estimated by the 
Spearman-Brown formula for triple length. 
The reliability coefficient for the Digit Symbol 
subtest was not determined since the total sub- 
test is measured by time and data were not 
available for individually timed items. 

Mean differences in coefficients of reliability 
between old and young control groups and be- 
tween old control and senile groups were de- 
termined by z-value transformations. 

To allow for the differences in variability 
between the groups, the method suggested by 
Helmick [6] was used. That is, the standard 
error of measurement [7, p. 130] was com- 
puted for each subtest in the groups and F 
tests were applied to the standard errors of 
measurments between groups. In addition, the 
coefficients of reliability were corrected for dif- 
ferences in range [7, p. 134] and the corrected 
reliabilities were compared by z-value trans- 
formations. 

Results 

The corrected subtest reliability coefficients 

of the old control and senile groups are present- 


Jack Botwinick 


ed in Table 1 (columns marked r). One reli- 
ability, that of the Comprehension subtest of 
the old control group (r = 0.35) is so low as 
not to be significantly different from zero ($ 


Table 1 


Age Differences in Reliability and Standard Error 
of Measurement of Subtests of the 
Wechsler-Bellevue Scale 


A B Cc 
Subtests Young control* Old control Senile 
N=50 N=50 N=31 
r og mease T g meas. r g meas. 
Vocabulary} .94 1.37 .96 148 94 1.69 
Arithmetic 82 1.06 .70 111 .92 085 
Information 32 1.58 .90 iñ .93 1.59 
Block Design .76 2.90 .84 2.51 .89 2.14 
Similarities 74 1.80 .89 1.4783 143 
Comprehension .53 1.96 .35 2.22  .69 1.89 
Object 
Assembly 46 1.90 62 2.50 .66 2.82 
Digit Span§ 44 145 .76 107 .ĉŝ51 1% 
Picture 
Completion 42 148 .83 1.25 .82 1415 
Picture 
Arrangement .29 2.23 .55 1.57 .87 118 


* From data of Webb and De Haan [12]. 

+N=36 for Column A and N= 34 for Column B of the 
Vocabulary subtest. "i 

EN =37 for Column A of the Object Assembly subtest. 
Object Assembly reliability coefficients were estimated 
the average intercorrelations of the items. 

§ N = 49 for Column A of the Digit Span subtest. 


< .01). Three coefficients prior to correction 
by the Spearman-Brown prophecy formula 
were also not statistically greater than zero 

< .01): the Comprehension and Object As- 
sembly subtests of the old control group, 47 

the Digit Span subtest of the senile grouP- 
Webb and De Haan [12] reported that the 
lowest four uncorrected coefficients for the 
young control sample population were not S18- 
nificantly above zero at p < .01, and that the 
corrected coefficient for the Picture Arrange 
ment subtest was below this level. 


When subtest reliability coefficients a 
compared between control groups, i.e, betwé in 
young and old control, only the differen” at 
reliability of the Picture Completion subt : 
was significant at the 1 per cent confident 
level. The remaining subtest reliabilities ee š 
not significantly different at the .01 level 4 ie 
though the reliability coefficients of the Die A 
Span subtest and the Similarities subtest ee 
significantly different at p < .05. Significa 


Wechsler-Belicvue Reliabilities: Differences in Age 


differences in reliability coefficients between old 
control and senile groups were seen in the 
Arithmetic and Picture Arrangement subtests 
(p < .01). The difference in reliability of the 
Comprehension subtest was significant at p < 
-O5 but no significant differences in reliabilities 
were indicated even at this confidence level for 
the other subtests. 

The differences between the old control and 
senile groups with respect to the standard 
errors of measurements presented in columns 
marked Gmeas in Table 1 were not statistically 
Significant. Age differences in the standard 
errors of measurements were significant for the 
Picture Arrangement subtest at the 1 per cent 
level and for the Digit Span subtest at the 5 
per cent level.? 

When the reliability coefficients were cor- 
rected for range and compared by z-value 
transformations, a difference between the two 
elderly groups was found at the 5 per cent 
level for only the Information subtest and no 
Statistically significant differences, even at this 
Confidence level, were found for the remain- 
Ing subtests. When age comparisons were 
Made for the reliability coefficients corrected 
for range, only the Object Assembly and Pic- 
ture Completion subtests were found to be sig- 
nificant. The confidence levels were 5 and 1 
Per cent respectively when the range of the old 
Control was corrected to that of the young 
Control, and 1 and 5 per cent respectively when 
the range of the young control was corrected 
to that of the old control. 


Discussion 


The results of this investigation have 1n- 
ticated that the range of the coefficients of re- 
‘ability for the different subtests was large in 
groups. From Webb and De Haan’s data 
[12], differences of .65 and .37 between the 
highest and lowest reliability coefficients were 
computed for a “normal,” i.e., young control, 
and a paranoid schizophrenic group respective- 
Y. The present data indicated ranges of 61 
and .43 for the old control and senile psychotic 
8Toups respectively. In general, the larger re- 
lability coefficients were about of the same 
? The author wishes to thank Drs. Webb and De 


Gia rded their data for the 


an, who on request, forw2 3 
Object Assembly biet so that the present analysis 


Would be complete. 
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magnitude for all groups, but the lower coeffi- 
cients appeared to increase in magnitude with 
age and psychoses. This was also reflected in 
the direct comparisons of reliability coefficients 
between the two control groups and between 
the control and psychotic groups of similar age. 
Webb and De Haan reported that the sub- 
tests in which the paranoid schizophrenic group 
were inferior were the ones in which higher 
reliabilities were manifested. In the present 
data, performance was lower in the senile 
group than in the old control group for all 
subtests. Yet those subtest reliabilities that 
were significantly different were in all instances 
higher in the psychotic group than in the old 
control group. 

Because of the relationship between reliabili- 
ty coefficients and range of ability, these find- 
ings suggested that there were group differ- 
ences with respect to variability, and that vari- 
ability increased with age and psychoses. Hel- 
mick [6] reported that in all but one subtest, 
Webb and De Haan’s paranoid schizophrenic 
group were more variable than the young con- 
trol group, although only one difference in 
variance was significant at less than the 5 per 
cent level. In the present data, the old control 
group was more variable than the young con- 
trol group in seven of the ten subtests, although 
only the Object Assembly and Picture Com- 
pletion subtests were significantly different 
with respect to variance (p < .01 ). The senile 
group was more variable than the old control 
group in six of the ten subtests, but three sub- 
tests were significantly different with respect 
to variance (Arithmetic and Information at p 
< .01, and Picture Arrangement at p < 05). 

In view of these differences in variability, 
the standard error of measurement appeared to 
be a more adequate index for comparison pur- 
poses. Helmick [6] found no significant dif- 
ferences in the standard errors of measure- 
ments between the young control and young 
psychotic groups and the present data indicated 
no significant differences between the old con- 
trol and senile groups. Therefore, the indica- 
tions are that in these studies there were ap- 
proximately equal errors in measurement with 
the Bellevue subtests for the different mental 
conditions within an age group. Between age 
groups, however, i.€., between young and old 
control groups, the Digit Span and Picture 
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Arrangement subtests were not of equal errors 
in measurement. There was greater error of 
measurement in the young control group. 

Conclusions’drawn from the comparisons of 
reliability coefficients corrected for range are 
tenuous. As Webb [11] indicated, this correc- 
tion creates a theoretical population and has 
more statistical than clinical meaning. Ac- 
cordingly, the differences between groups in 
reliability coefficients corrected for range were 
not given the consideration that the differences 
in uncorrected coefficients and standard errors 
of measurement were given. 

The present results were congruous with 
those of other reliability studies [2, 4, 5, 8, 9, 
12] on the Wechsler-Bellevue test. For pat- 
tern analysis and diagnostic considerations, 
where each subtest score is evaluated in terms 
of its deviation from the other scores, the error 
of measurement and the reliability of subtests 
must be improved before confidence in evalua- 
tion can be expected. 


Summary 


1. Three groups that were examined for 
the purposes of separate studies [1, 3, 12] 
were used. Two groups were apparently free 
of aberrant mental conditions and were ap- 
parently matched except for age and sex. The 
third group was comprised of 31 men and 
women hospitalized for senile psychosis and 
psychosis with cerebral arteriosclerosis. This 
group was matched with the older “normal” 
group and the only apparent difference was 
mental status. 

2. The general method of computing the 
reliability coefficients was odd-even item cor- 
relations corrected by the Spearman-Brown 
prophecy formula. The split-half reliability 
coefficients for each subtest were compared be- 
tween “normal” groups of different age and 
between the groups of the same age but differ- 
ent mental status. 

3. Age comparisons in reliability coeffici- 
ents indicated that a difference at p < .01 was 
found only for the Picture Completion sub- 
test. Comparisons between groups of different 
mental conditions of the same age indicated 
differences at p < .01 in reliability coefficients 
for the Arithmetic and Picture Arrangement 
subtests. When significant differences occurred, 
Poorer performance scores were found for those 
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subtests of higher reliability. Accordingly, 
standard errors of measurements were com- 
puted for each subtest and comparisons be- 
tween groups were made. No differences were 
found between the old “normal” and senile 
psychotic groups but the Picture Arrangement 
subtest was significantly different at f < 01 
between old and young “normal” groups. 

4. The coefficients of reliability and the 
standard errors of measurements, in general, 
were found to be too indicative of error tO 
warrant confidence in making diagnostic evalu- 
ations by pattern analysis from scores on 1n- 
dividual subtests. 
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Studies of the results of using the Wechsler- 
Bellevue Intelligence Scale [9] on various 
categories of neuropsychiatric patients have 
been numerous since its publication in 1939. 
Despite the wide interest in and use of this test, 
few such studies have concerned themselves 
with the changes in the subtest scores resulting 
from the prefrontal lobotomy operation. Of 
the various articles which have reviewed re- 
search with the Wechsler-Bellevue test [6, 7, 
8], only the most recent survey article by 
Rabin and Guertin indicates such a study. In 
this study McCullough [3] tested 10 patients 
one week before and two months after the 
Operation. Statistically significant gains were 
found on the digit span and picture arrange- 
ment subtests only. Rabin and Guertin, in 
their review, comment on this study that the 
€monstrated gains attributed to the inter- 
vening therapy might have been due to 
Practice effects, A recent article concerning 
test-retest reliability [1] shows that these are 
the two subtests with the lowest reliability, 
and strengthens the suggestion that the ob- 
tained results may well be due to practice. 
The present study was designed to deter- 
mine whether components of the IQ shift 
following lobotomy, even in those cases where 
the IQ remains relatively constant. It was 
hoped that such a finding would throw some 
ight on the psychological effects of prefrontal 
lobotomy and consequently on the functions 
Of the prefrontal lobes. In terms of the 
echsler, it was hoped that some cues as to 
the “functions” measured by each of the sub- 
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tests might be gained. 

Thus the study was expected to have a 
dual function—first, to clarify frontal-lobe 
function, and second, to clarify the meaning 
of shifts in subtest scores on the Wechsler- 
Bellevue. The criticism can be made that the 
study is circular and in a very real sense it 
is. The purpose of discovering concomitant 
variation seems quite defensible, however. 


Method 


Wechsler-Bellevue, Form I, weighted sub- 
test scores obtained before lobotomy and at 
least four months after lobotomy were com- 
pared. In terms of standard statistical tech- 
niques, the question to be answered was: is 
the variation in scores obtained before lobo- 
tomy different from the variation in scores 
obtained after lobotomy. 

A group of 17 patients was tested and re- 
tested, the retest being given between 4 and 
22 months postoperatively. Fourteen of these 
patients were males who were between 23 
and 38 years of age at the time of the pre- 
lobotomy test session. All 14 were classified as 
having a schizophrenic reaction; 8 as para- 
noid, 1 as probably paranoid, 2 as hebe- 
phrenic, 1 as catatonic, 1 as mixed, and 1, 
while diagnosed as a paranoid schizophrenic 
at the time of lobotomy, had strong psycho- 
pathic elements as indicated by both previous 
and later psychiatric opinion. 

The three female patients ranged in age 
from 25 to 28 years at the time of preopera- 
tive testing, and were all diagnosed as schizo- 
phrenics: 1 as paranoid, 1 as probably para- 
noid, and 1 as an unclassified schizophrenic. 

All of the scoring of the various tests was 
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checked by the authors. Where the original 
scoring was questionable, recourse was had to 
the supplementary guide for administering 
and scoring the Form I scale [2]. 

Psychiatric diagnosis and all pertinent case 
history data were checked for accuracy with 
the particular entries in the patient’s general 
clinical case file. 


Results 


The means and standard deviations for the 
pre- and postlobotomy subtest scores for the 
group of 17 patients were computed. There 
were no statistically significant differences 
in scores from the two testing situations. The 
degree of similarity between pre- and post- 
lobotomy subtest scores was obtained by com- 
puting correlation coefficients for each of 
these conditions for each of the subtests and 
for the verbal, performance, and total 
weighted scores. The limits of these correla- 
tions were then computed according to the 
r-transformation technique [4]. These re- 
sults are summarized in Table 1. 


Table 1 
Means, Standard Deviations, and Correlation 
Coefficients for the Pre- and Post- 
lobotomy Conditions 


(Scores in equivalent weighted score units; N17) 


o Ë Correlation 
Standard a 3 Coefficient 

Test Means Deviations Zi Limits 
Seales Pre- Post- Pre- Post- & 8 Max. Min. 


I 8.29 912 9.2 9.8 .85 96 .53 
c 6.70 7.53 7.8 8.8 .74 .92 .27 
D 5.94 6.29 69 73 .17 .68 -46 
A 6.52 658 80 8.0 .89 .97 .64 
S 6.76 782 32 9.0 .79 .94 .38 
V 8.05 8.11 8.9 8.8 .96 .99 .86 
PA 6.58 8.70 79 9.5 .82 .95 .45 
PC 7.41 782 86 86 .82 .95 .45 
BD 7.70 8.76 88 99 .85 .96 .53 
OA 7.94 923 9.2 10.2 .94 .98 .79 
DS 5.58 688 66 7.6 .71 .92 .22 


Totals 
v 34.64 38.29 38.3 41.9 .84 .96 .50 
P 35.52 41.35 40.2 44.7 .90 .97 .66 
T 70.18 79.65 81.6 86.1 .71 .92 .22 


Even though there were no significant 
differences between pre- and postlobotomy 
subtest scores, it was believed that a compari- 
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son of the correlation coefficient for each of 
the subtests where the “lobotomy variable” 
had intervened with test-retest reliability coef- 
ficients, where no lobotomy had intervened, 
would throw some light on the effects of the 
operation. 

Two of the subtests, the digit span and the 
block design, were further analyzed to de- 
termine intra-subtest differences. 

The means for the pre- and postlobotomy 
digit span subtest scores for “forward” and 
“backward” were computed. No differences 
which were statistically significant were dis- 
covered. For the block design subtest the 
results for Designs IV and VI, commonly be- 
lieved clinically to reveal organic involvement, 
were separated to discover any differences þe- 
tween the pre- and postlobotomy conditions. 
Counter to expectation, no increase in the ex- 
tent of organic involvement occurred follow- 
ing the lobotomy process. The only evidence 
obtained was that there was a slight but non- 
significant gain in the ability to do the easier 
of these block designs (IV). 

The deterioration coefficients for the pre- 
and postlobotomy conditions were computed 
by using the respective subtest means for each 


Table 2 . 


Comparison Table of Pre- and Postlobotomy 
Correlation Coefficients and Reliability 
Test-retest Coefficients 


Present Rabin Hamister 

Test Study* Study* Study* 
Scales (N=17) (N=30)  (N=34) 

I 185 89 94 

Cc 74 12 -78 

D 17 62 +63 

A 89 75 87 

s .79 .38 84 

v IE a -90 

PA .82 .54 -78 

PC 82 32 68 

BD 85 71 67 

OA 94 31 62 

DS 71 34 79 
Totals 

v Be 78 91 

P 90 52 

T 71 55 es 


Note—Rabin and Hamister studies from 
Aborn, and Canter [1]. ot 
*Test-retest intervals: Present study, 4-22 apes 

bin study, 1-35 mos.; Hamister study, 14-1 mo. 
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of these groups of scores. It was found that 
for the prelobotomy mean subtest scores there 
was an 18.77 per cent loss as compared to a 
Postlobotomy loss of 16.83 per cent. This 
difference was again nonsignificant. Stated 
another way, the results show that there was 
a small, nonsignificant reduction in the value 
of the deterioration coefficient following lobo- 
tomy for the 17 patients tested. 
Table 2 summarizes the coefficients for the 
Testorocest samples and for our data. It 
evident immediately that the three samples 
are quite similar. 
th The most striking dissimilarities occur in 
the cases of the digit span subtest and the ob- 
Ject assembly subtest. No explanation of the 
A a feasible unless we interpret it to 
ow § enag tht reported reliabilities are too 
I or our population. 
sible = case of digit span, however, it is pos- 
Gon to hypothesize that the lobotomy opera- 
ee a some way disturbs this type of func- 
ice R emembering that no significant differ- 
was nas pre- and postlobotomy means 
it is discovered (5.94 and 6.29 respectively), 
feta possible to conclude that there is a 
ogic te c increase or decrease in some psycho- 
Subtest ‘wap measured by the digit span 
ing is ; ut rather that this area of function- 
ation te affected than others by the oper- 
n some nonsystematic fashion. 
for pe comprehension and arithmetic sa 
See jf e two conditions were then eon : 
the ice change had occurred as a result : 
or e ers in the number of items apse 
usin of these subtests, regardless © 
Ps or Score received on the answer to the 
c oe item. No statistically significant 
an ges occurred in the patient s ability to 
Swer the various items composing the subtest. 
Stas, an article published in 1941, Raa [5] 
nig an index which he found aide Š 
p ration of schizophrenic patients from non 
he totic patients. This index showed no 
ange in the extent of the patients schizo- 
renic reaction pattern following lobotomy. 
rt fee 17 patients used in all of the statisti- 
al computations above were drawn from a 
mite Population of 55 patients who have had 
Se lobotomy operation. One of the most 
iking effects of the lobotomy W 


Crease in the cases who could be tested. For 


the total of 55 patients, the empirical evi- 
dence indicates that the lobotomy operation 
did increase the number of testable patients by 
20 per cent, although for 5.4 per cent of 
them only a partial improvement in “testabil- 
ity” occurred, i.e., they gave answers to some 
but not all of the subtests. 


Summary 


Pre- and postlobotomy Wechsler scores of 
17 psychotic patients were compared. While 
a general tendency to improve was noticed, 
there were few significant changes. Changes in 
two subtests (digit span and object assembly) 
showed a dissimilarity with test-retest changes, 
as indicated by correlation coefficients. Digit 
span for the lobotomy group was more vari- 
able, and object assembly less variable than in 
the “control” condition. Thus the psycholog- 
ical function measured by digit span appears 
to be the most disturbed by the operation. 
Several comparisons were made (e.g., deterior- 
ation coefficient, schizophrenic index), but the 
most striking change was in the increase of 
testable patients by 20 per cent after lobotomy. 
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Abramson, Harold A. Problems of consciousness. 
New York: Josiah Macy, Jr. Foundation, 1952. 
Pp. 10 + 146. $3.25. 


This small book of 156 pages embodies the trans- 
actions of the third of the conferences on problems 
of consciousness held by the Josiah Macy, Jr. 
Foundation. The report is a stenographic transcript 
of prepared papers and the comments and discus- 
sion of the 15 participants. The interchange is not 
only spontaneous and interesting, but frequently re- 
vealing, and is a beautiful example of the value of 
verbatim recording. Editing was presumably mini- 
mal. The papers were on consciousness and brain 
metabolism by Seymour Kety, on hypnotic phe- 
nomena by Lewis Wolberg, and on experimental 
work on sleep and other variations of consciousness 
by Marcel Monnier. Participants included represen- 
tatives of various medical and biological disciplines, 
psychologists, sociologists, and anthropologists, The 
difficulties the group experienced in attempting to 
reach a commonly accepted definition of conscious- 
ness are an eloquent example of similar difficulties 
in many communications of psychologists—A. R. 


Burlingham, Dorothy. Twins: a study of three 
pairs of identical twins. New York: International 
Universities Press, 1953. Pp. x + 92 +30 charts. 
$7.50. 


This report contains 30 developmental charts with 
mainly qualitative notations in various areas of be- 
havior. Little discussion is given to the methodo- 
logical problems involved in such a study. The 
greatest emphasis is placed upon the twins’ relation- 
ships to each other and to the social world around 
them. Attention is called to the active and passive 
roles that members of the pair assume. The phan- 
tasy of having twins is compared with the reality 
of twinships. Acquired differences are shown to be 
related to various factors. Identification is indicated 
as a process which keeps the twins identical in spite 
of their acquired differences—F. McK. 


Note.—The reviews were prepared by the Editor 


and the Associate Editors, who may be identified by 
their initials, 


Davidson,Audrey, & Fay, Judith. Phantasy in child- 
hood. New York: Philosophical Library, 1953. 
Pp. viii + 188. $4.75. 


This book discusses the meaning of childhood 
phantasy from a determinedly authoritarian Freudi- 
an point of view. At times the interpretations seem 
to transcend any reasonable limits of valid logical 
inference, and it is definitely not a book for the ex- 
perimentally minded. The case material is abund- 
ant and well chosen for interest, however, and if 
the reader is displeased by the rigidly analytic in- 
terpretations placed upon the phantasy material by 
the authors, he may substitute his own. The theo- 
retical context is that of Melanie Klein and Susan 
Isaacs, and the authors approach is expository 
rather than critical or creative. The volume is wel 
written, presented in an attractive format, and offers 
pleasant reading.—W. A. H. 


Garrett, James F. (Ed.) Psychological aspects of 
physical disability. Federal Security Agency, (o e 
fice of Vocational Rehabilitation, Rehabilitation 
Service Series No. 210. Washington: U. S- Gov" 
ernment Printing Office, 1952. Pp. vii 195. 
45¢. 

Psychological Aspects of Physical Disability gives 

a clear description of the psychological phases i 

the various types of handicaps. Although 18 and 

have written chapters in their special fields, the © 4 

tributions are so well blended and edited that Si 

has a feeling of a well-integrated whole. TUE 

an excellent chapter on psychiatric aspects of phy y 

cal disability, and another on the social psycho 

of adjustment to physical disability. While the tion 

is planned primarily for vocational rehabilitat Š 

counselors who are face to face with adult Pt it 

it contains so many practical suggestions PE any 
would be a valuable addition to the library 5 of 
psychologist. The book emphasizes the Pabili- 

reaching the individual, inspiring him to T 

tate himself.—B. M. L. 7 

ed- 

Garrett, Henry E. Statistics in psychology aik i 
ucation. (4th Ed.) New York: Longmans, 

1953. Pp. xii -+ 460. $5.00. 


WoE 
This old reliable text has had only zal i an 
lifting. There are some added materia!s 


face 
aly- 
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sis of variance, new problems, several rearrange- 
ments, and a new, attractive format.—L. F. S. 


Harrower, Molly. Appraising personality. New 
York: Norton, 1952. Pp. xvii + 197. $4.00. 


This attractive and highly literate presentation of 
Psychological techniques to persons in allied profes- 
sions is cast in the form of a dialogue between a 
psychologist and his physician friend. Gently, with 
case studies and other simple illustrations, the physi- 
cian is led to the psychologist’s use of the Rorschach, 
the Wechsler-Bellevue, figure drawings, incomplete 
sentences, and the Szondi. A final section shows the 
Integration of psychological methods in solving five 
difficult diagnostic problems. The book’s shortcom- 
mg is that it is almost too good. Persuasive exposi- 
tion, insufficiently tempered with critical appraisal, 
can ovyersell techniques whose real validity is in 
doubt.—L. F. S. 


Kluckhohn, Clyde, Murray, Henry A., & Schneider, 
David M. Personality: In nature, society, and 
culture. (2nd Ed.) New York: Knopf, 1953. Pp. 
xxv`- 701 + xv. Text edition, $5.75. 


In the revision of this useful sourcebook, the in- 
troductory essay on personality by Murray and 
Kluckhohn has been completely rewritten and con- 
siderably expanded, The essay, developed from the 
formula “tension—reduction of tension,” is itself 
a 47-page miniature treatise. The readings include 
of the 39 selections which were in the first edi- 
ion, together with 13 new ones, two of which are 
on the uses of literature for psychology—L. F. S. 


Aa aiin Clark E. Children in play therapy. New 
ork: McGraw-Hill, 1953. Pp. ix + 218. $4.50. 


dat ee the play therapy program with pre- 
D ool children at the Merrill-Palmer School of 

etroit, the author makes a great point of the differ- 
ence between nondirective and client-centered thera- 
Rion the one hand, and the “child-centered” thera- 
zA discussed in this book, on the other. The dif- 
erence is hard to find in the great amount of 
verbatim recording presented. He criticizes reflec- 
tion of feelings as a “repetitious, unsympathetic, 
static response.” His case illustrations are often ex- 
actly that. There are brief discussions of preventive 
play therapy, play therapy with normal children, 
situational play therapy (adapted from the author’s 
article in the Journal of Consulting Psychology, 
June 1951), and play therapy witb disturbed child- 
ren. About half the volume is devoted to the treat- 
ment of one preschool child and her parents. In 
this case, the mother’s presence in the play therapy 
room, brought about by the child’s refusal to leave 
the mother, and the insight the mother thus acci- 
dentally gained, were instrumental in the improve- 
ment of behavior and attitudes that followed. This 
book may be a “key to understanding normal and 


disturbed emotions” for some lay: i 
s S€ ymen. Psychologist: 
will find it superficial.—M. K. s on 


Sarason, Seymour B. Psychological problems in men- 
tal deficiency. (2nd Ed.) New York: Harper, 
1953. Pp. x + 402. $5.00. 


Sarason’s excellent book on mental deficiency has 
been extended rather than revised. Its usefulness 
has been increased by three added chapters on 
practical problems: the interpretation of mental de- 
ficiency to parents, criteria and procedures for in- 
stitutionalization, and problems of professional 
training.—L. F. S. 


Skinner, B. F. Science and human behavior, New 
York: Macmillan, 1953. Pp. x + 461. $4.00. 


An introductory textbook in psychology which 
contains not a single table, figure, or explicit ac- 
count of an experiment is indeed a rarity these days, 
especially when the author is an outstanding ex- 
perimentalist. Skinner seems to take the experi- 
mental basis of psychology for granted, although 
he pays considerable attention to its broader founda- 
tions as science, The most evident aspect of the 
author's position is his distaste for intervening vari- 
ables. “Drive,” for example, is not a stimulus, a 
physiological state, a psychic state, or a state of 
strength but “. . . a convenient way of referring to 
the effects of deprivation and satiation and of other 
operations which alter the probability of be- 
havior. . . .” To control behavior, the drive cannot 
itself be manipulated directly, but only the condi- 
tions of deprivation and satiation. The application 
of this conceptual framework to complex problems 
such as the self, anxiety, control, religion, and psy- 
chotherapy makes interesting reading. Furthermore, 
the author knows his literature, his philosophy, and 
his Freud, and bends them to his own ends. The 
result is a stimulating and challenging exercise for 
psychologists, although not all will be convinced. 
A different evaluation of the volume must be given 
with respect to its function as an introductory text- 
book. This book knows all the answers. The student 
is therefore likely to perceive psychology as a neatly 
wrapped bundle of truths, and is deprived of the 
opportunity to see scientific method as an ongoing 
process by which successive approximations of truth 
are reached without ever coming to an end. —L.F.S. 


Tests 
Blum, Lucille H., & Fieldsteel, Nina D. Blum-Field- 
steel Developmental Charts. Ages 0-6 yrs. Set of 
2 charts ($2.50 per 25), with manual, pp. 8. 
Yonkers, N. Y.: World Book Co., 1952, 1953. 


Two well-designed cumulative graphs are used 
to plot a child’s development according to the ob- 
servations and norms of Gesell and Amatruda. In 
each chart, the observations are plotted as an age- 
calibrated scale on the ordinate, with chronological 
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age aş the abscissa. The chart of Motor Behavior 
is concerned mainly with postural and locomotor 
development from “head erect” to “standing on each 
foot alternately with eyes closed.” The chart of 
Functional Behavior ranges from “holds objects” to 
“ties shoelaces.” The manual suggests uses of the 
charts by psychologists, pediatricians, nursery 
schools, rehabilitation classes, and others, with nor- 
mal and handicapped children.—L. F. S. 


Maslow, A. H. The S-I [Security-Insecurity] In- 
wentory. College-adult. 1 form. Untimed, (10) 
min. Inventory ($1. per 10, $7. per 100), with 
manual, pp. 10, and key. Stanford, Calif.: Stan- 
ford Univer. Press, 1952. 


Maslow’s 75-item questionnaire is the end product 
of a series of case studies and item analyses over a 
period of more than 10 years. The outcome is a 
technique far more refined than most short question- 
naires, with good reliability (about .90) and some 
clinical evidence of validity. Numerous applica- 
tions are suggested, for research, screening, student 
personnel services, and counseling. — L. F. S. 


Books Received 
Andrews, T. G. (Ed.) Méthodes de la psychologie. 
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Paris: Presses Univer. de France, 1952. 2 vols. 
Pp. vii -+ 882. 3.000 fr. 
Bernhardt, Karl S. Practical psychology. New York: 
McGraw-Hill, 1953. Pp. xii + 337. $3.75. 4 
Geldenhuys, J. Norval. The intimate life. New 
York: Philosophical Library, 1952. Pp. 96. $2.75. 
Halmos, Paul. Solitude and privacy. New York: 
Philosophical Library, 1953. Pp. xvii + 181. 
$4.75. 
Kraft, Victor. The Vienna circle. New York: Phil- 
osophical Library, 1953. Pp. xii + 209. $3.75. 
Ray, Marie Beynon. The best years of your life. 
Boston: Little, Brown, 1952, Pp. xiv + 300. 
$3.95. 
Reiss, Samuel. The universe of meaning. New 
York: Philosophical Library, 1953. Pp. xi + 227. 
$3.75. ‘ 
Runes, Dagobert D. The Soviet impact on society. 
New York: Philosophical Library, 1953. Pp. =" 
-+- 202. $3.75. 
Tead, Ordway. Character building and higher 
education. New York: Macmillan, 1953. Pp. x 
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Some Test Correlates of Response to 
Psychotherapy’ ; 


Frank Barron 
Institute of Personality Assessment and Research 
University of California 


This paper reports certain personality and 
intelligence test correlates of changes in psycho- 
logical morbidity in 33 adult psychoneurotics 
following six months of psychotherapy in the 
outpatient service of a state psychiatric clinic. 
These findings are part of the results of a study 
of somewhat broader scope, in which psycho- 
therapy was considered as a special case of per- 
sonal interaction in general, and in which 
therapeutic relationships and outcomes were 
rationalized in terms of the personality struc- 
tures of therapists as well as of patients [1]. 

The present paper, in addition to being 
restricted to a report on the test results only of 
hat nar- 
row conception of response to psyc therapy- 
The criterion variable can be best characterized 
as an answer to the question, “Did the patient 
improve or not?” where the word “improve” 
means some fairly general changes in state from 
bad to good. Examples of such changes are 
these: (a) The patient feels better, is more 
comfortable, takes more interest in life, and the 
like; (b) important interpersonal relations are 
straightened out a bit; (c) physical symptoms 
have been relieved or cured; (d) important 
health-tending decisions have been made; (e) 
there has been an increase in insightful remarks 
and behavior. 

The judgment as to whether or not im- 
provement had occurred was made by two 
expert observers (heads of departments at 
Langley Porter Clinic) who had not had any 


1This study was conducted for the most part at 


ter Clinic, San Francisco. It was com- 
Te the Institute of Personality Assessment 
and Research, and was supported financially by the 
grant of the Rockefeller Foundation to that Insti- 
tute. The author is indebted to Robert E. Harris, 
director of the psychology service at Langley Por- 
ter, for many valuable suggestions which contri- 


buted to the research. 


part in the conduct of therapy. Each therapist 
made a formal presentation before these two 
judges of every case he had handled; prior to 
the presentation the judges had read all of the 
material concerning the patient which had been 
recorded in the clinical chart. 

In the instruction to the judges it was em- 
phasized that the crucial variable was not 
general level of functioning of the patient at 
the conclusion of the therapy, but rather the 
change in state which had occurred between 
beginning and end of therapy. Further, it was 
made clear to the judges that part of their 
function was to evaluate the therapist’s in- 
volvement in his own account of the therapeu- 
tic process, and to weigh that factor in coming 
to a best estimate as to the degree of change 
which had actually occurred. 


On the basis, then, of two main sources of 
information (formal presentation of the case 
by the therapist, and an evaluation from the 
clinical chart), the expert raters assigned cases, 
first of all, into two main categories, those who 
had shown definite improvement and those who 
had failed to improve or who had improved 
only slightly. They were in close agreement on 
this crude categorization, differing on only 2 of 
the 33 cases which were studied and rated. In 
addition, they assigned ratings on a 100-point 
scale to each case, so that the total sample was 
ranked in terms of the variable “Improve- 
ment.” The correlation between the two inde- 
pendent sets of ratings was .91. The two dis- 
agreements were resolved by averaging the 
scale ratings. The final classification included 
17 patients in the Improved group, 16 in the 
Unimproved. 


Some Illustrations of Criterion Behavior 


It is of some interest to examine the kinds of 
incidents and outcomes which the judges con- 
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sidered indicative of improvement or lack of it. 
Here is a partial list of such incidents and out- 
comes, abstracted from the clinical charts of 
these patients: 


Improvement: 


1. A woman patient who had been frigid through 
four years of marriage which terminated in divorce 
now established an intimate relationship with 
another man in which for the first time she expe- 
rienced orgasm in sexual intercourse. 


2. A man who entered therapy in a very de- 
pressed, anxious, and physically upset state, and 
whose troubles centered on his relations with his 
foreman on a construction job (a relationship in 
which he was outwardly submissive and cooperative 
but inwardly enraged), finally learned to “stand 
up to” the foreman and express his feelings. There 
was a clear advance in his feelings of independence 
and self-esteem, and towards the conclusion of the 
therapy the patient left his former job and started 
a business of his own. 

3. A woman with menstrual difficulties related to 
unconscious hostility towards her husband because 
of his disregard of her own wishes in sexual inter- 
course became conscious both of her anger and her 
retaliative tactics, with consequent disappearance of 
the menstrual difficulties and a more candid and un- 
martyred relationship to her husband. 

4. A woman who had been recently divorced after 
an extremely traumatizing marriage and who en- 
tered therapy in a state of tremendous agitation and 
anxiety, so incapacitating that she could not sit in 
the lobby of the clinic or cross a street or look any- 
one in the face, gradually lost her phobias, expe- 
rienced a great reduction in anxiety, and became 
able to associate comfortably with other people. 

5. A man suffering from severe gastric disturb- 
ances which he considered unrelated to any emo- 
tional problems entered therapy upon the strongly 
worded advice of the internist. His dissociation 

of affect from the death of his mother and subse- 
quent disturbing childhood years in an orphanage 
was gradually broken down and he reexperienced 
his own sense of forsakenness and finally came to 
terms with it, crucially aided by the support and 
understanding of the woman therapist. 


Lack of improvement: 


1. A very dogmatic and dominating man who 
entered therapy at the insistence of his wife (who 
complained of his overbearingness with her and 
their three children) proved too overbearing for 
the young woman therapist as well. The therapist 
was unable to handle the negative countertrans- 
ference which developed, and the therapeutic inter- 
action became simply a battle, with consequent lack 
of improvement in the patient. 

f 2. A woman of forty, who had never been mar- 
ried and who suffered from continual headaches 
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and disturbing sexual impulses which she attempted 
to suppress, found herself obliged to terminate ther- 
apy for some good reason precisely after the hour at 
which the therapist had told her he would give 
her a physical examination on the occasion of their 
next appointment. : 

3. A man with a history of homosexuality at- 
tempted to seduce his male therapist, who responded 
with anger as well as some anxiety. The patient 
did not return. 

4. A psychopathic young man who had a lor 
history of rebelliousness, brushes with the law, and 
employment instability entered therapy because, s 
said, he happened to be passing by the clinic ane 
wondered what it would he like to be a paven 
He liked it for a while, especially as he happenee 
to be assigned to an attractive woman therapist, 
but after a few months he hitchhiked of in a 
southerly direction, leaving a chatty farewell note 
for the doctor in which he addressed her by her 
first name. 


ng 


5. An engineer of extremely masculine nppl 
ance and manners complained of a “psychic ma 
function” and wanted “a few treatments to get a 
the nuclear material and get the thing cleared upe 
His therapist insisted on taking a nondianetic, = 
hurried approach to the matter, which annoyed the 
patient, who nevertheless remained in therapy ‘i 
the expectation that something would eventually 
happen. 


One might summarize the kinds of outcomes 
in the Improved group as follows: (a) The 
patient generally reported a feeling of well- 
being at the conclusion of therapy, in contrast 
to depression and anxiety at its start; £ 
specific symptoms, such as headaches, frigidity, 
or impotence, gastric disturbances, menstrua 
difficulties, skin disorders, etc., tended to be a 
lieved or totally cleared up; (c) in some eo 
there were significant changes in the direc. 
of more mature interpersonal relations, vance 
ally with parents, parent-substitutes, or spouS 


be 
The failures in psychotherapy could often 


4 le 
traced to the inability of the therapist S 
some particularly difficult problem. i? i 


with more experienced psychotherapists 50 aif 
the patients who did not improve wou 
made some progress; however, there 
little doubt that the cases which were 
down as therapeutic failures were 
more difficult problems. As we shall 
from the test results, it was generally 
disturbed individuals who did not improv 


Test Correlates of Improvement . 
tients befo 


seeme? 
marke 
basically 
see later 
the more 


The test battery given these pa! 
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psychotherapy began consisted of a shortened 
form of the Wechsler-Bellevue Intelligence 
Scale, the Minnesota Multiphasic Personality 
Inventory, The Rorschach Psycho-diagnostic 
and the Ethnocentrism Scale (in Form 60 of 
the University of California Public Opinion 
Study scales). The patients themselves were all 
receiving psychotherapy for the first time, and 
they began the course of treatment just at the 
time that their therapists were starting a six- 
month period of service in the outpatient clinic. 
The therapists were psychiatric residents who 
had had little experience in intensive psycho- 
therapy. 

Most of the patients had one hour of treat- 
ment a week for six months. Of the 33 pa- 
tients, 12 were men and 21 were women. 
They ranged in age from 20 to 45. All but 3 
of them were high school graduates, but only 
2 were college graduates. As a group they 
could probably be characterized as lower-mid- 
dle-class socioeconomically. Two-thirds of 
them were gainfully employed. i 

All of the testing was done by the experi- 
menter. Conventional controls were exercised 
to prevent contamination in the prediction of 
outcome from the tests. The controls were as 
follows: (a) Only the experimenter knew the 
test results. The psychotherapists were in- 
formed of this condition before the experiment 
began, and were told that they would be given 
information concerning the testing only if in 
their judgment it was essential to the diagnos- 
tic formulation and the handling of the case. In 


three cases such information was requested by 


the therapist during the course of the therapy. 
The information given was not comprehensive, 
but was in response to some specific point. 
These cases were retained in the sample in spite 
of their being exceptions to the general rule, 
for their exclusion would be as likely a source 
of contamination as their retention. (b) The 
judges of outcome had no knowledge of the 
test results. (c) The test protocols were identi- 
fied by a code number rather than by name, so 
that clinicians who attempted to predict out- 
come had no knowledge of the patient beyond 
that afforded by the test results themselves. 
The design of the present study, so far as 
Prediction of outcome is concerned, is a repli- 
cation of some earlier work by Harris and 
Christiansen [5], who used in an almost iden- 


tical clinical setting a similar criterion of out- 
come of therapy and the same clinical tests, 
except that they did not employ the Ethnocen- 
trism scale. It is therefore in some respects a 
cross-validation of their findings, or at least it 
offers further evidence on some of the questions 
they discussed. Their results will therefore be 
compared with the present findings whenever 
such comparisons seem relevant. 

The Wechsler-Bellevue Intelligence Test. 
An abbreviated form of the Wechsler scale, 
consisting of the Comprehension, Similarities, 
Block Design, and Digit Symbol subtests, was 
used. Harris and Christiansen, using the same 
subtests, had found no significant relationship 
between Improvement and Intelligence. In this 
sample, however, the two variables were asso- 
ciated positively, the Pearsonian r being .46, 
which is significant at the .01 level. The mean 
of the Improved group was 122, that of the 
Unimproved group was 112. 

The mean IQ of the total sample was 117, 
as compared with a mean of 108 in the Harris- 
Christiansen study. An important difference 
between the two samples so far as method of 
selection is concerned should be noted: The 
Harris-Christiansen sample consisted of al- 
ready hospitalized persons who were given 
psychotherapy because of delayed recovery from 
physical disease, surgery, or accident, whereas 
almost all of the patients in the present study 
had elected on their own initiative to seek psy- 
chotherapy at the clinic, and in their waking 
hours went about the business of life in an up- 
right position. This difference might well ac- 
count for the IQ difference between the sam- 
ples, as well as for the fact that these self- 
referred patients were a good standard devia- 
tion above the general population mean in in- 
telligence. Simply being aware of the fact that 
psychotherapy is to be had and that it makes 
sense to seek it when you are in personal diffi- 
culties is probably related positively to general 
intelligence and cultural sophistication. 

It is also to be expected on theoretical 
grounds that greater effectiveness of cortical 
functioning (which presumably reveals itself 
on the Wechsler-Bellevue) should be associat- 
ed with a factor of modifiability in personality 
structure. Intelligence certainly involves the 
ability to cognize relationships adequately, in- 
cluding emotional relationships, and to correct 
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Fig. 1. Group MMPI profiles of 


Improved 52 54 60 
Unimproved 52 49 64 


one’s cognitions on the basis of new evidence. 
It would seem that in this sample, at any rate, 
the more intelligent patients were better able to 
use the psychotherapeutic relationship to in- 
duce desired personality changes. 

The Minnesota Multiphasic Personality In- 
ventory. The MMPI analysis may be divided 
into three main sections: (a) group differences 
between the Improved and Unimproved cases 
on MMPI scales; (b) prediction of outcome 
from MMPI profiles by clinical psychologists 
skilled in the use of the test, as well as by cer- 
tain rational indices or rules for mechanical 
sorting of the profiles; (c) development and 
cross-validation of a prediction scale. Enter- 
prises 1 and 2 will be reported in this paper; 
the development and cross-validation of a pre- 
diction scale will be reported separately, how- 
ever, as it involved work with a number of 
other samples and raised some test-specific 
questions which are not properly within the 
scope of this paper [2]. 

roup comparisons on the usual diagnostic 
and validity scales are shown in Figure 1. Only 


Hy Pd Mf, Mfp Pa Pt Sc Ma 
63 72 62 48 57 62 66 56 
68 69 67 47 66 71 74 6l 


the Improvedand Unimproved groups. 

on the Paranoia scale was there a significant 
difference between the means of the Im 
and Unimproved groups (t of 2.6, Ż = 
The Unimproved group profile is cons!s 
higher on almost all scales, however, 4? 
peak is at Schizophrenia, with the average 


prove 


tently 


also. 
scores for Psychasthenia and Depression ajs 


being greater than 70. The sorts of indiv! si ; 
who earn profiles like this are usually eri 
in An Atlas for the Clinical Use of the Lene 
[6], most of the 8724 profiles carry 4 ee eo 
of reactive depression with underlying 8¢ 4 


trends (pp. 668-669). This fits well with 


at 

È : istiansen t. 
observation by Harris and Christian’ witb 
. . , 

poor prognosis is generally assola ran s 
what they call “subclinical psychot!c | an 


: tion t 
referring to a more severe ego dysfunc e De 
o indicat "he 


first clinical impression seems t eat 
pression and anxiety are salient feature s 
clinical picture in almost all patients x 
psychotherapy in the outpatient clinic; OY om 
patients who fail to improve are those waite the 
paranoid and schizoid features ai gues? 
psychoneurotic symptoms. A reason’ 
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would be that their personal difficulties are 
more chronic and characterologically based, in 
contrast to the more acute and situation-linked 
problems of the patients who improve. 

The 33 individual MMPI profiles were also 
given to clinical psychologists for prognostic 
evaluations. Eight clinicians independently at- 
tempted to predict outcome from the profiles, 
having no other information concerning the pa- 
tient beyond age and sex. Each clinician sorted 
the 33 records into two groups, predicting 
either that the case would be improved or that 
it would be unimproved. Of 264 (8X33) such 
classifications, 164 (62.12%) were correct. 
The sum of the eight values of chi square was 
20.46, which for 8 df yields a p less than 01. 
The three best sorters had a pooled accuracy 
percentage of 69.7%. All of the sorters were 
more often correct than in error, but it should 
be pointed out that an average accuracy of 62% 
when 50% would be expected by chance 1s a 
fairly modest achievement in clinical predic- 
tion. Even the best of the MMPI analysts 
would be well advised to be tentative in their 
prognostic formulations. 5 

Rational indices and rules for mechanical 
sorting produce substantially the same accuracy 
of prediction as do sortings by clinicians; actu- 
ally, such indices are slightly more effective. 
Two fairly simple and obvious mechanical pre- 
dictors were put to the test. The first of these 
employed the rule that for any profile with all 
scores within the normal range (i.e., greater 
than 30, less than 70) Improvement should be 
predicted. Ten profiles met this requirement, 
and 9 of these cases had in fact improved. 
Twenty-four of 33 profiles (73%) were thus 
classified correctly (chi square of 8.1, p<.01). 
Exceptions were then allowed in the general 
rule: e.g., profiles with only D, or with only D 
and Pt, greater than 70 would be called Im- 
proved. Both exceptions led to an accuracy of 
prediction between 75 and 80%. 

In addition to these sorting rules, a simple 
index of subclinical psychotic trends was de- 
fined by summing the scores of four scales (F, 
Pa, Sc, and Ma) usually found elevated in 
psychosis. This index correlated .40 with out- 
come as it had been rated on a 100-point scale. 

It is of some interest that the same indices 
which predicted response to psychotherapy 
worked equally well in another setting, with a 


sample apparently quite different from the pa- 
tient sample at this clinic. In a study of per- 
sonal effectiveness in male graduate students in 
their final year of work for the doctorate, rat- 
ings were obtained from faculty members on 
certain dimensions such as originality and per- 
sonal soundness. The averaged faculty ratings 
on personal soundness for 40 such students 
correlated—.4 with the index defined by the 
sum of F, Pa, Sc, and Ma, and had a contin- 
gency of .52 with a mechanical sorting of the 
MMPI profiles using the rule that all profiles 
having no clinical scale elevation (except D ) 
of 70 or above should be called Sound, while 
all others should be called Unsound. 

The “personally sound” graduate students 
were different from the “personally unsound” 
students in the same way that patients who 
profited considerably from psychotherapy dif- 
fered from patients who profited little or not 
at all. As one would expect, however, there was 
a difference in absolute level of adjustment; 
the distribution of scores on the Prognosis for 
Psychotherapy scale [2] showed a clear pro- 
gression in group means from the Unimproved 
patients through the Improved patients and the 
Unsound graduate students to the Sound grad- 
uate students. 

What these relationships indicate, it would 
seem, is that the patients who are most likely 
to get well are those who are not very sick in 
the first place. Another way of putting this is 
to say that patients who are more integrated to 
begin with are better able to use the psychother- 
apeutic relationship to solve whatever problems 
brought them into therapy. A corollary of this 
is that the potential gains from therapy should 
increase as therapy progresses, at least up to 
the point where the critical problem for the 
patient is to become genuinely independent of 
the therapist. By that time, of course, the ther- 
apeutic process has become internalized, and 
personality problems have been brought “into 
the ego,” to be dealt with rationally and objec- 
tively. 

The Rorschach Psychodiagnostic. The Ror- 
schach analysis was carried out according to the 
same general design as the MMPI analysis, 
with the exception that no prognostic scale was 
developed. Average profiles were determined 
for the Improved and Unimproved groups, us- 
ing the Klopfer-Kel'y conventions for the scor- 
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ing and nomenclature of determinants. Indi- 
vidual scores on the Harris-Christiansen Ror- 
schach Prognostic Index [5] were computed, 
and the relationship of Outcome to that index 
was calculated. Finally, the test protocols, in- 
cluding both content of responses and profiles 
of determinants, were given to clinicians for 
sorting. 

All of Rorschachs were administered by the 
experimenter, with all of the verbalizations and 
relevant behavior of the patient being recorded. 
The tests were scored independently by the ex- 
perimenter and by one other clinical psycholo- 
gist who had had several years of experience 
both in the scoring and the interpretation of the 
Rorschach. The experimenter himself had had 
approximately three years of clinical experience 
with the test, in addition to a graduate course 
in its scoring and interpretation. The two inde- 
pendent scorings showed a high degree of agree- 
ment; discrepancies were reconciled in a con- 
ference on review of the scoring. The Improv- 
ed and Unimproved groups did not differ 
significantly on any Rorschach determinant, 
nor on any of the important ratios, such as W, 
D, Dd, plus 8, M: sum C, and so on. This 
finding is consistent with Rorschach results in 
the gradute student sample previously referred 
to; in that study no significant relationship was 
found between any Rorschach determinant or 
combination of determinants and the criterion 
variable, Personal Soundness. 

The Harris-Christiansen Prognostic Index 
correlated .00 with Improvement. As Cronbach 
[3] has pointed out, most empirical Rorschach 
indices fail to hold up under cross-validation, 
so that this is not a surprising finding. 

Somewhat contrary to the expectation of 
most persons who have worked with the test, 
however, is the finding that experienced Ror- 
schach interpreters were not able to predict 
outcome of therapy on the basis of the Ror- 

schach evaluation. Four clinicians, all of whom 
were highly trained and experienced, both in 
the use of the test and in general clinical prac- 
tice, attempted the sorting task. They had at 
hand all of the responses of the patients, as well 
as a summary of the scoring in terms of the 
usual ratios and profile of determinants. Only 
one of the four sortings approached signifi- 
cance, and that was in the negative direction; 
that is; the sorter was more often wrong than 
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right in predicting outcome. 

The Ethnocentrism scale. Certain theoretical 
considerations had led to the inclusion of the 
Ethnocentrism scale in the test battery. Levin- 
son [7] had found, in a study at this same 
clinic, that ethnocentric patients showed a per- 
sonality syndrome of a sort which would be 
resistant to change through psychotherapy. 
High-scoring patients were described by her 23 
having the following characteristics : “rigid, 
constricted personalities . . . stereotyped, Ton 
ventionalized thinking . . . undifferentiated 
egos . . . narrow range of experience, emotion- 
ally and intellectually . . . weak interpersonal 
relationships, expressed in terms of dominance- 
submission.” The low-scoring patients, ON the 
other hand, were marked by their “desire to be 
loved and fear of being rejected . . . expresse 
directly in interpersonal relations and in @ very 
personalized way ... the frequency with which 
low scorers discuss their relationships to others 
is striking.” 

These considerations suggested the hypothe- 
sis that patients who scored high on the Ethno- 
centrism scale would be less likely to enter 
deeply into the sort of personal interaction 
which occurs in psychotherapy. From the very 
beginning of therapy they would find it nec” 
sary to narrate the comings and goings of their 
somatic complaints, and to minimize the impor” 
tance of their psychological problems as p 
cause of their somatic disturbances. Accordin 
to this notion, ethnocentric patients would te? 
characteristically to isolate affect and to avoi 
psychological self-examination; they WOU 
strangers to their own inner life. aaf 

While the psychological formulation Its 
was not checked on in any detail in the P 
study, the hypothesis that it led to (i.e 4 to 
Ethnocentrism ‘would be negatively relate tion 
Improvement) was confirmed. The correla as 
of the E scale with Improvement ratings em’ 
—.64, making it the best single predictor 
ployed in this study. 1d be 

Several reservations, however, shon scale 
noted. In the first place, scores on t “hich can 
are negatively related to intelligenc w pa psy” 
be presumed to be a somewhat more td AS 
chological variable than ethnocentr!® item’ 
Gough [4] has pointed out, many ° 
in the E scale are written in such an 
fashion that a person of some intellige 
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education could not agree with them, even 
though the sentiment expressed might win his 
approval if the form of its statement were less 
clearly irrational. Since Improvement is correl- 
ated positively with Intelligence in this sample 
(.46), one would expect a negative relationship 
between Improvement and Ethnocentrism on 
the basis simply of their common relationship 
to Intelligence. 

When Intelligence is partialled out, how- 
ever, some relationship remains. The coefficient 
of partial correlation between Ethnocentrism 
and Improvement, with Intelligence held con- 
stant, is—.34. Partialling intelligence out in 
this manner is not strictly correct, of course, 
except in a mechanical way; actually, some 
underlying emotional-cognitive variable such as 
rigidity, which is complexly related both to in- 
telligence and to ethnocentrism, may be ac- 
counting for a large part of the correlation 
of both of those measures with the capacity for 
psychological change as shown by improvement 
In therapy. 

There is one other reservation to be noted. 
Four of the psychotherapists in this study were 
Jewish, a fact which might have affected both 
the ethnocentric patient’s attitude towards 
them and their attitude towards the ethnocen- 
tric patient. In several of the therapeutic inter- 
actions, such patient attitudes came out into the 
open, and were dealt with therapeutically; and 
in at least one case the therapist admitted can- 
didly to the psychologist that his own response 
to the patient’s anti-Semitism was disruptive of 
the relationship. 

In spite of these reservations, however, the 
relationship between ethnocentrism and capa- 
city for psychological change through psycho- 
therapy is a striking one, and if confirmed 
would be of some theoretical importance. It 
may, indeed, have implications for social com- 
munities as well as individuals, and would 
suggest that the social organization which fos- 
ters prejudice might well be forfeiting the kind 
of emotional flexibility which is necessary if in 
time of crisis it is to cure its own ills. 


Summary 


Change in psychological morbidity as a con- 
sequence of six months of psychotherapy was 


studied in a sample of 33 adult psychoneurotics 
who were treated in the outpatient service of 
a state psychiatric clinic. Changes for the better 
might be summarized as follows: (a) The pa- 
tient generally reported a feeling of well-being 
at the conclusion of therapy, in contrast to de- 
pression and anxiety at its start; (b) various 
psychosomatic symptoms tended to be relieved 
or cured; (c) significant interpersonal rela- 
tions were established on a more mature basis. 

Patients were rated on the degree of their 
improvement by two skilled judges who evalu- 
ated both the interview-by-interview account of 
the therapy in the clinical chart and the thera- 
pist’s report in conference on the course and 
outcome of the therapy. Ratings of degree of 
change for the better were then correlated with 
various psychological tests. 

The chief test correlates are these: (a) In- 
telligence is positively associated with change; 
(b) level of integration at the beginning of 
therapy is positively associated with change 
(i.e., those who are better off to begin with 
are likely to improve the most) ; (c) ethnocen- 
trism is negatively related to change. 
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„A Nonintellectual Intelligence Test ** 
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The title of this paper may be something of 
a misnomer, for it is not at all certain that the 
testing instrument which is going to be present- 
ed is, actually, a measure of intellect. Neverthe- 
less, it does correlate significantly with conven- 
tional tests of intelligence, and seems to reveal 
other properties which suggest that something 
along the line of intellectual ability, or perhaps 
more precisely intellectual efficiency, is being 
appraised. The other part of the title—the 
“nonintellectual” part—has not been the cause 
of any misgivings, because, as will be seen 
shortly, the test instrument does not call for 
any problem solving, reasoning, abstract think- 
ing, or any of the other mental functions which 


1This paper is one of a series of studies concerned 
with the development of practical assessment devices 
for the identification of positive and favorable as- 
pects of personality and temperament. The project 
is being carried out under a research grant from 
The National Institute of Mental Health, National 
Institutes of Health, U. S. Public Health Service. 

2The present paper is a revision and extension 


are traditionally regarded ‘as the key factors 19 
defining and measuring intelligence. N 

The two immediate aims of this project 
were first, to determine whether a poten 
specific set of personality inventory items cou 
be assembled which would correlate significant 
ly with accepted measures of intellect, 4% 
second, if this was successful, to determine 
whether the individual items could be combine ‘ 
in a scale which would have anything approach 
ing practical significance and value. 

The second objective is added, because, aS W 
know for instance from work on the Rorschach 
[1], aseries of variables can easily be identifie 3 
which will correlate significantly with inte 
ect, but which will seldom rise above the = 
of + .20 and + .25 into a region of more i 
pendable utility when pooled in a composite. 


Procedures 


ah a ; r sto 
The first step in the present project ues 
write a series of criterion-specific inven 


of a preliminary report given at Fresno, California, . -iate items 
April 26, 1952 at the annual meeting of the West- Items, and also to select appropri? fa spe 
ern Psychological Association. from standard sources. An example 0 
Table 1 
Item Statistics for Four Items from the Ie Scale 
Percent saying “True” 
Higher scores on Lower scores 0? 
intellectual intellectual S 
m Item ability measures ability measure 
Schools pees schoo! P 
School A BandC SchoolD School A BandC “(x 48) 
(N28) (N21) (N48) (N28) (N20) 
1. It is more important that a father 6? 
be kind than that he be successful. 79 95 92 71 76 
2. Parents are much too easy on their 67 
children nowadays, 36 43 46 50 ji 
3. I am not afraid of picking up a er 
disease or germs from door knobs. 86 81 85 79 67 
4, Most people make friends because 
friends are likely to be useful to 7 
them. 21 19 29 46 i 
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Table 2 


Summary Statistics for the First (76-item) Intellec- 
tual Efficiency (Je) Scale in the Original Samples 


Sample N M SD Fi 
School A 135 52.44 8.51 47 
School B 35 51.34 9.20 68 
School C 66 51.41 9.41 64 
School D 205 51.93 9.51 5+ 


*Intercorrelations hetween the Ie scale and a con- 
ventional IQ test in each of the schools. 


Table 3 


Summary Statistics for the First Je Scale 
in Six Cross-Validating Samples * 


Sample N M SD rt 


I. For the abbreviated 
(59-item) scale. 
1. St. Cloud ninth grade 82 38.09 7.46 .53 
2. Minneapolis ninth grade 190 39.44 8.24 -36 
3. St. Cloud twelfth grade, 


1947 231 39.55 7.50 .52 
4. St. Cloud twelfth grade, 7 
1948 271 40.30 7.70 47 


5. University of Californ- 


ia advanced graduate r 
students 40 48.58 4.02 .42 


II. For the full (76-item) scale 
1. University of Califor- 
nia first-year gradu- 

ate students in 
psychology 
* The first five samples were scored only for the 59 


items taken from the MMPI. The psychology sample 


le. Has 
ieee Tao, ‘graduate student samples, the weenn 
test was the Miller Analogies Test, form g. por the other 
samples, conventional IQ measures were used. 


30 63.20 5.12 44 


cially written item would be, “I get sort of 
annoyed with writers who go out of their way 
to use strange and unusual words,” and of an 
item from a standard questionnaire, in this 
case the MMPI [5], “I gossip a little at 
times.” 

These items were then reproduced in a book- 
let and administered to the senior students in 
four Minnesota high schools.* In each school, 
the responses of students in the upper 25 per 


The four communities were: Bemidji, Dawson, 
elo "Falls, and St. Cloud. The writer wishes 
to thank the following persons for making this test- 
ing possible: Mr. R. B. Clay, Mr. C. H. Dahlin, 


Mr. H. B. Gough, Mr. R. Gray, Mr. J. W. Smith, 
Mr. R. H. Sorenson, Mr. G. Ramseth, and Mr. R. 


H. Witt. 


. 


cent of the range on a conventional intelligence 
test were compared with those of students in 
the lower quartile.* 

Table 1 provides an example of the way in 
which the analysis was conducted. Items which 
showed consistent and significant differences 
in all Hi-Lo comparisons were retained for the 
scale. Altogether, 76 items were identified 
which met this criterion. 

These 76 items were scored on the original 
samples with the results indicated in Table 2. 
The next step was to cross-validate this scale. 
Table 3 presents the results observed in six 
cross-validating samples." In the first five, only 
MMPI [5] items were available, but the sixth 
sample took the full 76-item scale. All of the 
correlations are clearly significant, statistically, 
and all save one are high enough to be of some 
practical value. An interesting finding here was 
the degree to which the scale retained its valid- 
ity when checked in the graduate student sam- 
ples where one would encounter rather severe 
attenuation of the criterion measure.® 

The individual items were also checked in 
the two graduate student samples, and it was 
discovered that 24 of them were contributing 
only slightly, if at all, to the correlations with 


4Because of the small number of cases available, 
schools A and B were combined into a single sample 
for this analysis. 

®The first four samples were made available 
through the kindness of Mr. M. J. Lunemann, Dr. 
Starke Hathaway, Mr. F. J. Herda, and Mr. H. B. 
Gough. The graduate student samples were seen 
at the University of California Institute of Person- 
ality Assessment and Research, Dr. D. W. Mac- 
Kinnon, Director, as part of a large-scale study of 
personal and social effectiveness. The Institute 
projects are being carried out under a grant from 
the Rockefeller Foundation. 

6The preliminary 59-item MMPI version was 
tried in the Michigan clinical psychology assess- 
ment program [6]. The abbreviated Ie scale yield- 
ed significant correlations with the following cri- 
terion variables: diagnostic competence (.21); in- 
dividual psychotherapy (.32); professional inter- 
personal relations (.28); over-all clinical compe- 
tence (.23); preference for hiring (.24); and lik- 
ing (.23). 

The correlations for professional interpersonal re- 
lations and for individual psychotherapy were both 
the second highest obtained among all the objective 
scales utilized in the Michigan study (including 
the Miller Analogies Test, 6 Primary Mental Abili- 
ties test scales, 14 Guilford-Martin scales, 10 con- 
ventional MMPI scales, 59 scales on the Strong 
Vocational Interest Blank, 9 Kuder Preference In- 
ventory scales, and 6 scales from the Allport-Vernon 
Study of Values). 
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the criterion tests. It was decided, accordingly, 
to eliminate them and to reduce the scale to 52 
items.” This 52-item scale is the one which is 
currently beig used, and it is also the version 
included in the California Psychological Inven- 
tory." These 52 items, and the scored respon- 
ses, are listed below. 


1. I have had very peculiar and strange experi- 
ences. (False) 2. It often seems that my life has no 
meaning. (False) 3. When someone does me a 
wrong, I feel I should pay him back if I can, just 
for the principle of the thing. (False) 4. Any job 
is all right with me, so long as it pays well. (False) 
5. People often expect too much of me. (False) 6. 
I get sort of annoyed with writers who go out of 
their way to use strange and unusual words, (False) 
7. Success is a matter of will power. (False) 

8. When in a group of people I have trouble 
thinking of the right things to talk about. (False) 
9. It is more important that a father be kind than 
that he be successful, (True) 10. I was a slow 
learner in school. (False) 11. I must admit I have 
no great desire to learn new things. (False) 12. 
My skin seems to be unusually sensitive to touch. 
(False) 13. Parents are much too easy on their 
children nowadays. (False) 14. I read at least 
ten books a year. (True) 

15. I have the wanderlust and am never happy 
unless I am roaming or traveling about, (False) 
16. My parents have often disapproved of my 
friends. (False) 17. Teachers often expect too much 
work from the students, (False) 18. I am not afraid 
of picking up a disease or germs from door knobs. 
(True) 19. I am quite a fast reader. (True) 20. 


7A table listing each item, the percentage in each 
sample responding “True,” and the significance 
tests has been deposited with the American Docu- 
mentation Institute. Order document No. 3972 from 
the ADI Auxiliary Publications Project, Photodu- 
plication Service, Library of Congress, Washington 
25, D.C., remitting $1.25 for 35-mm. microfilm or 
$1.25 for 6- by 8-in. photocopies. 

8The California Psychological Inventory, copy- 
right 1951. This inventory is designed to assess a 
number of social and interactional variables. Its 
emphasis is not on medical, psychopathological, or 
maladaptive characteristics, but, rather, on more 
favorable and positive aspects of individual func- 
tioning. It contains 19 scales, including measures 
for social responsibility, flexibility, academic motiva- 
tion, tolerance, ete, See, for example, references [3] 
and [4], 


mm eity-nine of the 52 items were taken from the 


a 2257, 256F, 260F, 267F, 277, 280F, 304F, 
38F, 3927, 448F, 455F, 4goT 464T, 487F, 492F 
521T, 524T, 526F, 541F) 546%, 552T, SSOP. 
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I have had more than my share of things to worry 
about. (False) 21. I feel like giving up quickly 
when things go wrong. (False) 

22. In a group of people I would not be em- 
barrassed to be called upon to start a discussion 
or give an opinion about something I know well. 
(True) 23. I like to read about history. (True) 
24. In school I found it very hard to talk before 
the class. (False) 25. I dread the thought of an 
earthquake. (False) 26. I like science. (True) 
27. I am bothered by people outside, on street cars, 
in stores, etc. watching me. (False) 28. I have 
never been in trouble because of my sex bçhavior. 
(True) . 

29. I often get feelings like crawling, huraina 
tingling, or “going to sleep” in different parts : 
my body. (False) 30. I seem to be about as ene 
and smart as most others around me. (True) 31. 
like poetry, (True) 32. I am quite often not in on 
the gossip and talk of the group I belong t% 
(False) 33. A windstorm terrifies me. (False) at 
I enjoy a race or game better when I bet on ats 
(False) 35. Most people make friends because 
friends are likely to be useful to them, (False) 

36. I have never seen a vision. (True) 37. The 
future seems hopeless to me. (False) 38. I hars 
had no difficulty s arting or holding my ara 
(True) 39. I often feel as if the world was JUS 
passing me by. (False) 40. I get pretty discourage’ 
with the law when a smart lawyer gets a grimin 
free. (True) 41. The only interesting part gf t 
newspaper is the “funnies.” (False) 42. I gossip * 
little at times. (True) 

43. At times I have been so entertained by 
cleverness of a crook that I have hoped he phar 
get by with it. (True) 44. I have had attac i i 
which I could not control my movements or spe 3 
but in which I knew what was going on ar ae 
me. (False) 45. I have had no difficulty in sta" ike 
or holding my bowel movement, (True) 46- 
to read about science, (True) 47. I do i 
every editorial in the newspaper every dagr 
48. If people had not had it in for me, i 
have been much more successful. (False) 49- 
dream very little, (False) 5 

50. I have often been frightened in ge reat 
of the night. (False) 51. I work under i about 
deal of tension. (False) 52. I seldom worry 
my health. (True) 


the 


t ren 
True) 
woul! 


day” 


r ting 
. . e 2 teres 
A review of these items is quite NEP" cor- 


a 
in highlighting some of the personologt” tho! 
relates of general intelligence. The oe of the 
of extracting the immediate impliet tas 
items is simply to read the list carefu a clus” 
an aid in forming rational groupe. i 
ters the following synopsis is provided: 


e, 
-assurantê,, 
self pensions: 


freedo™ 


1. Self-confidence and H 
from unsubstantiated fears and app 


A Nonintellectual Intelligence Test 245 


2. Effective social technique and adjustment, 
sense of social acceptability without dependence on 
others; not suspicious, touchy, or overly sensitive. 

3. Good physiological functioning, absence of 
minor, debilitating symptoms and complaints. 

4. Liking, and respect, for intellectual pursuits; 
wide range of interests. 


Three additional samples were then obtained 
in order to cross-validate the 52-item revised 
scale." Table + presents the findings. The va- 
lidity coefficients are about what they were 


Table 4 


Summary Statistics for the Revised 
(52-item) Te Scale 
in three Cross-yalidating Samples 


Sample N M SD r* 


1. Rock Island, Illinois 


high school 461 33.90 7.07 .49 
2. Wellsville, New York, 
high school 230 34.08 6.39 .50 


3. University of California 
undergraduate psychology 


students 43 40.05 5.16 .42 


* Intercorrelation between the le scale and a con- 
ventional measure of intelligence in each sample. 


10The Rock Island, Illinois, sample was obtained 
‘through the courtesy of Mr. Charles O. Austin, Jr.; 
the Wellsville sample through the kindness of Dr. 
H. D. Babcock; and the University sample through 
fhe Courtesy of Dr. David Krech and Mrs. Ann 
iller, 


. 


with the first six cross-validating samples, so it 
appears that the shortening did not weaken the 
scale’s effectiveness. 

Final high school grade averages were also 
available for the Rock Island sample. For the 
females, the correlation between grades and 
tested IQ was .56, and between grades and the 
Ie scale .59. For males the correlation between 
grades and IQ was .51 and between grades and 
the Je scale .31. 

In order to provide an over-all picture of the 
summary statistics at this point, the means and 
standard deviations for each sample have been 
proportionately equated to the 52-item test ver- 
sion with the results indicated in Table 5. In 
this table one can observe a consistent rise in 
mean scores from junior high school groups, 
through senior high school and college under- 
graduate levels, to a final culmination in the 
graduate student samples. 


Adjective Check List 


The last data to be presented on this scale 
have to do with the “social-stimulus values” 
of persons scoring high and low on it. Forty 
graduate students seen in an intensive 3-day as- 
sessment at the University of California Insti- 
tute of Personality Assessment and Research 
were given the scale. Staff judges completed 
Gough Adjective Check Lists [2] for each as- 


Table 5 
Ie Scale Summary Statistics for All Samples* 
Samples N M SD r SE 
I. Original samples 
1. Bemidji twelfth grade 135 35.87 = o .09 
2. Dawson twelfth grade 35 35.12 i d 47 
3. Redwood Falls twelfth grade 66 35.16 6.44 64 12 
4. St. Cloud twelfth grade, 1949 205 35.52 6.50 54+ 07 
II. Cross-validating samples 
1. St. Cloud ith ade 82 31.80 6.52 53 11 
2. Minneapolis ninth grade 190 34.74 7.26 .36 07 
3. Rock Island high school 461 33.90 7.07 49 05 
4. St. Cloud twelfth grade, 1947 231 34.84 6.61 52 07 
5. St. Cloud twelfth grade, 1948 271 35.50 6.78 AT 06 
6. Wellsville high school 230 34.08 6.39 50 07 
7. University of California undergraduate 
psychology students 43 40.05 5.16 42 15 
8. University of California first-year 
graduate students in psychology 30 43.23 3.50 44 19 
9. University of California advanced 
graduate students 40 42.80 3.54 42 16 


* Scores for samples not taking the final 52-item scale were proportionately corrected to equate them to this 


standard. 
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sessee, and then these observer-reports were 
composited. Adjectives differentiating signifi- 
cantly between the composite reports on the 10 
highest and 10'lowest scorers on the Ze scale are 
given below: 


1. Adjectives checked more frequently about 
higher scorers. 


adaptable kind 
appreciative logical 
capable obliging 
clear-thinking persistent 
conscientious planful 
considerate pleasant 
cooperative reasonable 
dependable realistic 
energetic reliable 
enterprising responsible 
helpful sincere 
honest stable 
industrious thorough 


interests wide 


2. Adjectives checked more frequently about 
lower scorers. 


aloof impatient 
cynical individualistic 
defensive moody 
deliberate resentful 
effeminate sarcastic 
headstrong sharp-witted 


The general trend of adjectives ascribed is 
quite clear. High scorers are described as capa- 
ble, clear-thinking, dependable, logical, realis- 
tic, etc., and low scorers as cynical, headstrong, 
impatient, and resentful. 


The adjective findings lend support to the 
notion that the Je scale is measuring something 
like personal or intellectual efficiency, with 
their emphasis on characteristics such as indus- 


triousness, planfulness, reliability, and thor- 
oughness. 


Harrison G. Gough 


Summary 


A study was made of the relationship be- 
tween intellectual measures and a series (o 
opinion, attitude, and self-description items, be- 
lieved, on a priori and theoretical grounds, to 
covary with intellect. Fifty-two items were 
found to possess empirical validity. These items 
were assembled in a scale which yielded medi- 
an validity coefficients of approximately 58 in 
four original samples, and of .47 in nine check 
samples. : 

Adjectival descriptions of subjects scoring 
high on the scale tended to stress factors of de- 
pendability, intellectual clarity, persistence, an 
planfulness. The decision was made to call the 


: + ancy!) If 
scale a measure of “intellectual efficiency * 
order to reflect these properties. 
Received December 3, 1952. 
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A Repetition of Meyer Williams’ Study of Intel- 
lectual Control under Stress and Associated 
Rorschach Factors’ 


Virgil R. Carlson and Richard S. Lazarus 


The Johns Hopkins University 


For many years psychologists interested in 
problems of psychological stress have assumed 
that impairment of performance as a conse- 
quence of stress was associated entirely with 
such personality variables as neuroticism and 
lack of emotional control. This point of view 
was supported in a study by Meyer Williams 
[12], which was aimed at the validation of two 
indices of “emotional” or “intellectual” control 
in the Rorschach test. Combining these two 
indices in the prediction of performance on the 
Digit-Symbol test under conditions of psycho- 
logical stress, Williams obtained a remarkably 
high multiple correlation of .824. This study 
was important not only because it provided 
support for certain Rorschach concepts, but 
also because it related directly to the practical 
and theoretical problem of predicting behavior 
under conditions of psychological stress. 

There are four principal reasons why this 
finding of Williams is surprising and requires 
verification. Some of these considerations have 
been pointed out in a recent review article on 
the field of stress [8]. In the first place, it is 
impossible to define psychological stress in 
terms of stimulus situations such as threat of 
failure, electric shock, and similar factors, 
when the performance of particular individuals 
is being predicted. Varying motivations and 
past experience of the subjects must determine 
the extent to which they are involved in the 
situation, how they interpret it, and what their 
response will be. 


1This research was supported in part by the 
United States Air Force under Contract No. AF 
33 (038) -22624 monitored by the Perceptual and 
Motor Skills Research Laboratory of the Air Train- 
ing Command Human Resources Research Center. 
Permission is granted for reproduction, translation, 
publication, use and disposal in whole and in part 
by or for the United States Government. 


247 


Second, Williams’ stress situation was a com- 
bination of stresses, including simultaneously 
the threat of failure, electric shock, and the 
presence of observers watching the subjects as 
they performed. The situation therefore tapped 
a variety of needs and past experiences which 
are not likely to be comparable from subject to 
subject. Any single personality measure such 
as “emotional control” cannot be expected to 
correlate highly with responses to so complex 
a threat situation. Third, certain experiments 
have recently produced evidence which con- 
flicts with the findings of Williams. For one 
thing, some of these experiments have shown 
that “neurotic” or “anxious” subjects may per- 
form better than nondisturbed subjects in cer- 
tain kinds of stress situations [5,10]. Also, a 
number of investigators have been unable to 
predict performance under stress by means of 
Rorschach measures even when the task used is 
comparable or the same [1, 4, 6, 9]. Finally, a 
serious limitation of Williams’ study is the fact 
that it depended upon a sample of 25 cases, 
which is really too small for a reliable estimate 
of a correlation. 

For these reasons it was important to deter- 
mine whether Williams’ results are repeatable. 
Since it is possible that his experiment may 
have contained just the right combination of 
factors for predicting performance under stress 
from Rorschach measures, we have made the 
greatest effort to repeat the study as accuratel: 
as possible in every essential detail. 4 


Procedure 


Twenty-five white male college students re- 
ported individually for two experimental sess- 
ions. In the first session the subjects were given 
the Rorschach test according to the procedure 
outlined in Beck [2]. After a five-minute 
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rest period, five 90-second trials were given on 
the Wechsler-Bellevue Digit-Symbol test [11]? 
with a one-minute break between trials. Each 
subject was teld that the Digit-Symbol test is 
part of a standard test of intelligence, and he 
was encouraged to do as well as possible. 

‘The second session occurred a day or two 
later. The subject was first given six more 
practice trials on the Digit-Symbol test. Again 
one-minute rest periods intervened between suc- 
cessive trials, and a three-minute rest period 
was interpolated between the third and fourth 
trials. The last three of these practice trials 
were designated the “control period” and 
constituted an estimate of the subject’s non- 
stress performance. Then the subject was taken 
immediately to another room for three more 
Digit-Symbol trials under the stress conditions. 

During the “stress period” the subject sat at 
a desk in a small room behind a one-way screen. 
He could not see out but could be observed 
from outside the room. A camera was mounted 
in front of the screen facing into the room. 
Three to five Persons, including at least one 
woman, observed the subject’s performance.’ 
The subject was introduced to the observers be- 
forehand and shown the one-way screen 
arrangement. Electrodes were Strapped to the 
subject’s nonwriting hand and a panel contain- 
ing a white light and a red light was located on 
the table in front of him. The experimenters 
rated each subject, during his performance, on 
a four-point scale for behavioral signs of stress, 
such as trembling, sweating, tenseness, etc. 


The following instructions were played on 
a tape recording :* 


“You are now being observed by a number of 
Psychologists on the other side of the screen who 
are taking notes and continuous photographs of all 
your reactions throughout the remainder of this ex- 
periment. All directions are to be followed im- 
Plicitly. Rest your arm attached to the electrodes 


2The test was lengthened sufficiently to preclude 


the possibility of anyone completing it in the time 
allowed. 


Williams group of observers consisted of three 
to five persons, including at least two women. Our 
one-way screen was approximately 2X3 feet, where- 
as Williams’ screen was 8X4 feet. Our experimen- 
tal room was also apparently smaller than the one 
used by Williams. 


*These instructions were reproduced verbatim 
from Williams’ Teport, 


on the table and keep it there from now on. You 
will notice that the electrodes on your arm are con- 
nected to the panel before you. (White light turned 
on and left on.) The white light which has just 
gone on indicates that our shock apparatus has been 
turned on. You are connected to this apparatus. 
During the following period you may receive i 
strong electric shock whenever the observers fee! 
that your test performance is not up to our standards. 
(Red light turned on.) Whenever the red light 
Goes on, you are not meeting our standards and yon 
are in danger of being shocked—like this! (Shock 
administered through electrodes, red light turned 
of.) Now pick up your pencil and look at the test 
blank before you. It is the same test you took just 
a few minutes ago. Your instructions are the same 
as before. At the signal ‘Go’ work as fast as you 
can until you are told to stop. Concentrate on your 
work. Remember, your reactions are being 
served and continually photographed and you will 
be shocked whenever your test performance falls 
below our standards, Get set for Trial 1. Go!” 


Five seconds after the “Go” signal the red light 
was turned on and left on until five seconds be- 
fore the end of the trial, Just before the red light 
went off, the subject received a rather strong electric 
shock. Ninety seconds after the “Go” signal, the 
tape recording resumed: 

“Stop! Place the test you have just completed 
on the right side of the table. You will shortly be 
called upon to repeat the test. Remember, you an 
being observed and continually photographed cae 
you will be shocked whenever your test ay 
ance is below our standards. (Pause) Get set t0 
Trial 2. Go!” This second “Go” signal ore 
one minute after the “Stop” signal at the end far 
Trial 1. The same Procedure was repeated yee 
Trials 2 and 3. At the end of Trial 3, the tapo is 
cording informed the subject, “The experimen are 
finished. Remain seated until the electrodes 
removed.” 


The subject was then taken to another e 
and asked to fill out Winne’s Neuroticism tio 
[13] and a questionnaire concerning mea’ the 
to stressful situations. After completing o 
questionnaires, he was interviewed in ane © 
determine his subjective reactions to vane pu“ 
mental situation and to explain to him “tione 
pose of the experiment. He was also iment 
to maintain secrecy regarding the ape wer 
The questionnaire and interview sess 
additions to Williams’ procedure. as gives 

A control group of 15 subjects obs accor 
the same number of Dighton ead co! 
ing to the same time schedule. T! > thes? 
ditions, of course, were not impos 


subjects. 


gs 
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Table 1 i 
Summary of Rorschach Performance 
Williams’ 
Rorschach Experimental experimental 
category group group 
Mean Range SD Mean Range SD 
Sum C/Total C 83 5-1.0 .176 88 -5-1.2 -20 
F + % Total 76.8 50-100 13.31 81.6 70-100 6.59 
F + % Color Cards 70.1 0-100 26.40 75.5 50-100 9.28 


Results 


Each of the Rorschach records was scored 
both according to Beck [2] and according to 
Klopfer and Kelley [7], yielding a basis for 
four quantitative scores. ‘These scores were: 
(a) Sum C/Total C, (b) F + % for the total 
record, (c) F + 9% for the color cards alone, 
and (d) Buhler, Buhler, and LeFever’s Basic 

orschach Score [3].° The first three of these 
— the Rorschach measures used by Wil- 

ams. 


Sum C/Total G was determined by sum- 
ming the weighted numerical values of the var- 
Hous color responses (FC = .5, CF = 1.0, C 
= 1.5) and dividing the sum by the total num- 
ber of color responses. A high Sum C/Total G 
value represents poor integration of form with 
color, and supposedly, poor emotional control. 
F + 9% is the ratio (multiplied by 100) of the 
number of responses scored F + to the number 
Scored F + plus the number scored F —. A 
high F+ % represents good form quality, and, 
Supposedly, a high degree of intellectual con- 
trol. The Basic Rorschach Score is derived 
from a diagnostic sign list based primarily on 
Klopfer’s system of scoring. Some 102 separate 
Signs are each given a numerical weight, posi- 
tive or negative. The algebraic sum of these 
Weights constitutes the Basic Rorschach Score, 
Tepresenting an over-all estimate of the degree 
of maladjustment or personality disintegration. 
A high positive Basic Rorschach Score is said 
to indicate good personality integration. 

Table 1 compares the performance of our 


5In order to conform with Williams’ procedure 
Our Rorschachs were administered according to 
eck’s instructions, which differ from the procedure 
Set forth by Buhler, Buhler, and LeFever. Our ob- 
tained Basic Rorschach Scores may therefore lack 
Strict comparability with those obtained by other 


investigators, 


experimental group with the performance of 
Williams’ group on the pertinent Rorschach 
variables. The important thing to note here is 
that the two groups appear to be quite compar- 
able. If anything, our group represents a some- 
what greater range of individual differences, at 


least with respect to the F + %. 


* DASHED LINES INDICATE REST PERIODS 


CONTROL GROUP (N=15) 


NO. SYMBOLS CORRECT 


TRIALS 
Fig. 1: Digit-symbol test performance for the con- 
trol and experimental groups. 


Comparison of the two groups in perform- 
ance on the Digit-Symbol test is somewhat 
more complicated. Williams found that 11 
trials were sufficient to reach a plateau of no 
further improvement. The mean number of 
digits correctly completed for Trials 9, 10, and 
11 (Control Level) minus the number cor- 
rectly completed for Trials 12, 13, and 14 
(Stress Level) was taken as a measure of 
decrement under stress. Figure 1 shows that 
our control group certainly, and our experi- 
mental group probably, had not reached a pla- 
teau by Trial 11. Consequently, Williams’ 
stress score more nearly represents a decrement 
from the point of maximum performance than 
does ours. Most likely this accounts for the fact 
that Williams’ average Stress Decrement is 
nearly twice as large as ours (refer to Table 
2). If we were to teke the extrapolated learn- 
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Table 2 
À Summary of Digit-Symbol Test Performance 
Control Experimental 

Digit-Symbol measures group group 
Mean SD Mean SD 
(1) Control Level 93.7 18.97 85.1 16.69 
(2) Stress Level * 102.1 19.70 79.3 15.19 
Stress Decrement (1 minus 2) -8.47 4.04 5.8} 8.34 
(10.4)§ (5.70) 

t. 7.72 3.41 

p -001 01 


* A second “control level” for the control group. 


+ Minus score represents improvement in performance. A 
t If the extrapolated learning curve is used instead of the actual control level, the decrement is 11.0. 
§ Values in parentheses are those obtained by Williams, 


ing curve of our experimental group as an esti- 
mate of the group’s maximum performance, we 
would obtain an average Stress Decrement 
which is almost exactly equal to the value ob- 
tained by Williams. Our actual stress measure, 
however, is statistically significant and its 
standard deviation is fully as large as in Wil- 
liams’ data. Further, since our control group 
shows a significant increase in performance 
during the period corresponding to the stress 
trials of the experimental group (see Table 2), 
we believe that we succeeded in producing as 
effective a stress situation as did Williams. 

In our data the amount of Stress Decrement 
on the Digit-Symbol test is correlated with the 
Control Level. This was not the case in 
Williams’ data, and probably the reason is that 
his subjects had more nearly approached their 
maximum level of performance. In any event, 
we derived a set of “corrected” Stress Decre- 
ment scores which do not correlate with per- 
formance in the control period. We first calcu- 
lated the predicted Stress Decrement scores by 
means of the regression equation predicting 
Stress Decrement from Control Level. Then 
the obtained Stress Decrement minus the 
predicted decrement constituted the Corrected 
Stress Decrement scores. Correlations with 
the various Rorschach and other personality 


°Another method, which is perhaps more logical, 
consists in predicting stress-level performance from 
the control level by means of the regression equation 
Predicting Stress Level from Control Level and then 
subtracting the Stress Level scores from the pre- 

icted scores. The scores obtained in this way cor- 
related 996, however, with the Corrected Stress De- 
crement. scores described above, suggesting that it 
made little difference which method was used. 


measures were computed for this measure aS 
well as for the original Stress Decrement: The 
same result, elimination of the influence O 
control level of performance, could have been 
achieved by computing partial correlation coe! 
ficients, and any correlation involving Correct- 
ed Stress Decrement should be interpreted as & 
partial correlation. 


We found, as did Williams, that subtracting 
the lowest trial in the stress period from the 
highest trial in the control period resulted 19 
a set of scores (here called Stress Maximu™ 
which correlated highly with the Stress Dect 
ment (differences between the means eA 
two periods). Consequently, there was Heee 
point in correlating this measure with other 
variables. Another measure (not used by wi j 
liams), however, correlated only slightly wit 
Control Level or with Stress Decrement sas 
so seemed worth while to explore. This 1 : 


Table 3 is 
Intercorrelations among Digit-Symbol Te 
Measures 
SE Re m of 
pi sad pi a o 
o 5 
Control Level 42 -01 r 
(.05)} ai 94 
Stress Decrement -90 a (93) 
32 


Corrected Stress 
Decrement 


jal. 
* Last stress trial minus first stress, ee trish pams: 
7 Highest control trial minus age re py Wi 
$ Values in parentheses are those © 
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provement under stress. It was obtained by 
subtracting the score for the twelfth trial (first 
trial under stress) from the score for the four- 
teenth trial (last trial under stress). 

The intercorrelations of these various Digit- 
Symbol measures are presented in Table 3. A 
correlation of about .40 is required for signifi- 
cance at the 566 level of confidence.’ 

The correlations between the stress measures 
and the Rorschach measures are shown in 
Table 4. The two most important correlations 
in Williams’ study were between Stress Decre- 
ment on the one hand and Sum G/ Total C 
and F + % on the other. The combined pre- 
dictive power of these two Rorschach measures 
Wes relatively great, yielding a multiple corre- 
lation of .824. We do not corroborate this find- 
ing at all. Our correlations between Stress De- 
crement and F + 0%, and F + % on the color 
cards, are near zero. Our correlation between 
Stress Decrement and Sum C/Total C ap- 
proaches significance, but it is in the opposite 
direction from Williams’ correlation. More- 
Over, this last correlation becomes clearly in- 
Significant when the influence of control per- 
formance is removed from the Stress Decre- 
ment score. As might be expected, our multiple 
Correlation between Stress Decrement and Sum 
C/Total C plus F + % (.39) is practically 
the same as the correlation between Stress De- 
crement and Sum C/ Total C alone. It might 

e considered to approach significance except 
for the fact that it is in the wrong direction. 
In addition, Stress Decrement failed to corre- 


Table 4 


Correlations between Digit-Symbol Test 
Measures and Rorschach Measures 


Sum CO F+% F+% Basic* 
Total € Color Rorschach 
Total cards score 
Stress Decrement =37 16 .06 —.17 


(.35)t(-.61) (-72) 
Corrected Stress -.28 05 02 -.07 
Decrement 
Improvement under 


Stress 


*Buhler, Buhler, and LeFever sign check list. 
+ Values in ‘parentheses are those obtained by Williams, 


late with the Basic Rorschach Score, the Be- 
havior Rating, or either of the questionnaires. 


-.07 12 -03 —.18 


7All correlations referred to in this paper are 


Pearson product-moment coefficients. 
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The only positive instance of correlation in 
all our data was between Improvement under 
Stress and Winne’s Neuroticism Scale. The 
correlation coefficient in this case was + .54, 
meaning that the subjects showing greater 
neuroticism or anxiety on the inventory tended 
to show more improvement during the stress 
trials. Also, the correlation between the neurot- 
icism inventory and Behavior Rating* ap- 
proached significance with a coefficient of + 
37, Neither the inventory nor the Behavior 
Rating correlated with any of the Rorschach 
measures, however. 

The most noteworthy fact derived from in- 
terviewing the subjects was that they consid- 
ered the electric shock the most disturbing fac- 
tor in the situation. Most of them expressed the 
view that the one-way screen helped them to 
ignore the presence of the observers. And in 
general they claimed to have paid little or no 
attention to the red light, which was supposed 
to signify below-standard performance. When 
they did think about the light, it seemed to 
carry the implication of the imminence of shock 
rather than failure. It would take some further 
experimentation to ascertain the actual contri- 
bution of each of these factors to the decrement 
produced in performance. In our own opinion 
the electric shock did indeed contribute the 
most, but it is not clear in what precise way. 
Part of the effect of the shock was apparently 
just a simple and momentary mechanical inter- 
ruption in performance. 


Discussion 


The primary result of the present study is 
the complete lack of corroboration of Williams’ 
findings. This result, however, agrees with our 
theoretical expectations concerning the problem 
of psychological stress and with other experi- 
ments having to do with the prediction of per- 
formance under stress from Rorschach meas- 
ures. Experiments by Deese and Lazarus [4], 
Eriksen, Lazarus, and Strange [6], Stopol 
[9], and Allee [1] have all produced negative 


8Ea.h of the experimenters (independently) rated 
the behavior of the subjects for overt signs of stress 
during performance on the stress trials. The rating 
categories ranged from 1 (little indication of stress 
effect) to 4 (pronounced indications of stress). Since 
the two independent sets of ratings agreed fairly 
highly, they were combined into a single Behavior 
Rating score. 
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results. In the experiment most similar to Wil- 
liams’ prior to the present report, Stopol found 
no significant relationship between any Ror- 
schach measure and performance under stress. 
Since Williams’ experiment stands alone, it 
seems reasonable to reject his results as repre- 
sentative of the relationship between Rorschach 
variables and performance under stress. 

Williams’ experiment was undertaken from 

the point of view of validating certain Ror- 
schach concepts, whereas in the researches 
cited above the Rorschach measures were sec- 
ondary to the study of the effects of stress on 
performance and their prediction. From the 
viewpoint of Rorschach validity, even if form 
quality and form-color integration could be 
properly designated as representing emotional 
or intellectual control, our theoretical position 
with respect to the determinants of perform- 
ance under stress would not lead us to expect 
a substantial relationship between such “con- 
trol” and performance under stress. Indeed, 
one could even make the reverse prediction on 
the basis of the findings that neurotic individ- 
uals may do better than nonneurotics under 
certain kinds of stress conditions [5, 10]. 

What is important from an empirical point 
of view is that these Rorschach measures do 
not enable us to predict the kinds of behavior 
which have been studied here. We cannot be 
certain whether this means that the Rorschach 
concepts are inadequate or whether the behav- 
ior studied is inappropriate to test them. In 
order to be useful, the concepts of emotional 
and intellectual control must lead to some valid 
behavioral prediction. 

A final word must be offered with respect 
to the correlation which was found between 
Improvement under Stress and the scores on 
the neuroticism inventory. Although this cor- 
relation is large enough to be statistically 
significant, in a matrix of so many correlations 
one might obtain such a relationship by chance. 
But if it can be substantiated, it is undoubtedly 
related to the finding, mentioned previously, 
that neurotics sometimes do better than non- 
neurotics in stress situations. 


Summary 


An experiment by Meyer Williams, in 
which a high degree of relationship was found 
between performance under stress and Ror- 
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schach measures of emotional and intellectual 
control, was repeated with careful attention to 
every essential detail. The repetition was neces- 
sitated by the appearance of conflicting 
evidence concerning the efficacy of the Ror- 
schach in predicting performance under stress, 
the belief that a competent theory of psycholog- 
ical stress precluded the finding of substantial 
relationships, and the fact that Williams’ con- 
clusions depended upon a small sample of 25 
cases. 

The task used was the Wechsler-Bellevue 
Digit-Symbol test. Each of 25 subjects com- 
pleted a total of eleven trials on this test under 
control conditions and then three trials under 
stress conditions. The stress consisted of elec- 
tric shock, failure information, and the 
presence of several people observing the per- 
formance of the subject. The difference be- 
tween the subject’s performance during the 
three trials preceding the stress period and the 
three stress trials constituted the measure © 
decrement due to stress. These data were com- 
pared with the performance of a control grouP» 
indicating stress effects which were quite com- 
parable with those reported in Williams’ studY: 

The performance of our group of subjects 
on the relevant Rorschach variables was also 
comparable to that of Williams’ subjects with 
respect to mean, range, and standard deviation: 
There was no relationship, however, between 
the Rorschach measures and decrement in Pe 
formance under stress, 


In view of the fact that all other similar s 
vestigations have produced negative resu i 
is reasonable to conclude that the correlatie 
reported by Williams is not representatiy’ jes 
the relationship between Rorschach varia 


and performance under stress. 


Received November 17, 1952. 
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Subcategories of Rorschach Human Movement 
Responses: A Classification System and 
Some Experimental Results’ 


Robert P. Barrell 


Veterans Administration Hospital, New Orleans, Louisiana 


Several authors, in Rorschach literature, 
point to some relationship between various 
types of human movement responses (M) and 
various personality characteristics, and present 
clinical hypotheses regarding the interpretation 
of them. Rorschach [10] himself had some 
ideas regarding the relationship of extensor and 
flexor aspects of the movement to activity and 
passivity within the personality of the subject. 
Wheeler [13] seems to feel that certain char- 
acteristic types of M are found in overt homo- 
sexuals. Beck [3] suggests that the direction of 
the movement (away from or towards the cen- 
ter of the card) tells something about the sub- 
ject’s activity or passivity. Piotrowski [9] 
differentiates several types of movement (along 
an extensor-flexor scale) as being related to 
various personality characteristics, relative to 
self-assertion and submissiveness. 

It is common practice in the clinic to utilize 
the hypotheses referred to above, or similar 
ones, regarding the meaning of the various 
types of human movement responses, and to ac- 
cept them as maxims for interpretation. Yet, 
aside from the work of Wheeler, there does not 
seem to be any clear validation of these hypo- 
theses. Thus the problem demands investiga- 
tion. 


The Classification System 


It is obvious that for crucial experimental 
work there must be a clear-cut classification 
system. ‘This system, it seems, should meet at 


1 From doctoral dissertation, University of Michi- 
gan, 1950 [1]. The author wishes to acknowledge 
his indebtedness to the late Professor Louis Granich 
and to Professors Max L. Hutt, E. Lowell Kelly, 
Irving H. Anderson, Edward S. Bordin, and Don- 
ald G. Marquis. 
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least two criteria: (a) The various categories 
should be clearly defined, permitting the least 
possible amount of ambiguity; (4) the subcate- 
gories should yield a high coefficient of relia- 
bility with respect to scoring. Another desirable 
aspect of such a classification system wou be 
that there be, insofar as possible, a continuum 
instead of purely categorization, which wou 
allow for more adequate statistical manipu‘ 
tion. 5 

Yet, when the existing classification systems 
for M are examined, not even one is fount 
clearly to meet these criteria. Furthermore, it 18 
obvious that these classification systems ovet!@P 
each other to a great extent. The Hutt-Miltom 
classification [8] is similar to that of Ror- 
schach [10] in that extensor and flexor aspects 
are considered; Werner [12] draws closer a 
his “action,” “expression,” and “posture dar 
sification; and Zubin [14, 15] cuts across mos 
of these in a different way, considering not of 
activity but interaction with other people 2” 
with the environment in general. 


meet the criteria set forth above. 
Following Zubin [14, 15] the new 
cation system of the M response we 
around two concepts prominent in t ry 
classifications: (a) the amount 0 em 
pended in the movement; an how’ 
of interaction with the environment pe 
the response. Thus was parma 9 har- 
Energy Classification, which invo aa 
acterization of the response with resp 


ssifi- 
Ait 
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amount of energy expended in terms of the 
total body, the limbs and the face, respectively. 
Next was developed an Interaction Classifica- 
tion, which considered: (a) degree of interac- 
tion with nonanimate objects in the environ- 
ment; (4) degree of interaction with humans 
specified or implied by the response; and (c) 
the type of interaction with humans specified or 
implied by the response- Where there was no 
interaction with humans or with nonhuman 
objects in the environment, & classification of 
the kind of action involved in the response was 
used; for example, “a man standing” would be 
classified as involving no movement in space, 
and “an angel flying” would show no specific 
direction of movement. 

Further, since it was desired to determine 
whether sex designation in the M response had 
any relationship to personality variables, a Sex 
D esignation Classification was constructed. 
This consisted of: (a) designation as male and 
how so designated (whether primary or second- 
ary sex characteristics, or both, were referred 
to, or whether no reason was given for the sex 
designation); (b) designation as female and 
how so designated ; (c) absence of sex designa- 
tion; (d) vacillation in sex designation, such as 
giving one sex in the free association and an- 
other in the inquiry, or verbal evidence of con- 
fusion concerning the sex of the person seen- 


Details of the Classification System 
The Energy Classification 

1. Whole body. (a) Human seen as expending 
energy yigorously with the total body. Examples: 
fighting, dancing, running, whirling. (b) Human 
seen as expending a modicum of energy- Examples: 
walking, standing, talking. (c) Human seen as ex- 
Pending little energy- Examples: sitting, lying, 
kneeling; any postural response. 

2. Limbs. (a) H or Hd, seen as expending 
energy vigorously with limbs. Examples: hitting, 
kicking, throwing. (b) H or Hd, seen as expend- 
ing modicum of energy with the limbs. Examples: 
shaking hands, playing patty-cake, stirring. A) H 
or Hd, seen as expending little energy with the 
limbs. Examples: pointing, gesturing- 


3. Degree of activity in facial expressions (re- 
gardless of H or Hd). (a) Much energy utilized. 
Examples: calling for help, shouting. (b) Modicum 
of energy utilized. Examples: laughing, talking, 


2H is the conventional symbol for Human, and 


Had for Human Detail. 
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(c) Little energy utilized. Examples: 


grimacing. 
peering, looking angry- 


looking, smoking, 
The Interaction Classification 

1. Objects in the environment. (a) Human seen 
as not responding to any object in his environment. 
Action is entirely self-referred. (b) Human at- 
tempting to manipulate object or objects in his 
environment. Examples: pulling, pushing, lifting, 
carrying. (c) Human seen as avoiding object in 
his environment. Examples: running away from 
something, cringing. (d) Human seen as being 
manipulated by his environment. Examples: pushed, 
driven, etc. by some object in his environment (ob- 
ject specified). (e) Human just responding to some 


object in his environment, as holding something. 
(f) Human looking at something in his environ- 
ment. 


2. Degree of interaction with people. (a) Human 
not seen as relating to other people in his environ- 
ment. Action is entirely self-referred. (b) Human 
aware of the presence of other people in his environ- 
ment, but not taking any direct action as a result 
of this. Examples: looking at someone, smiling at 
someone, shielding something. (c) Human seen as 
responding to another human, but amount of action 
is only moderate. Examples: walking, talking, beg- 
ging. (d) Human involved in much action with 
other people. Examples: fighting, dancing, working. 

3. Type of interaction with people. (a) Expres- 
sion of aggression. (b) Expression of affection. 
(c) Cooperation with others, as in work activity. 
(d) Subject of aggression. (e) Miscellaneous activ- 
ity, ©» facing each other. (f) Lecturing, advising, 
talking, gossiping, directing. (g) Vacillation, e.g., 
affection-aggression. 

4. Direction of movement. (a) Movement with- 
out any specific direction. Examples: floating in air, 
keeping time with music. (b) Moving up. (c) Mov- 
(d) Moving to the right. (e) Moving to 


ing down. 
e.g., standing, 


the left. (f) No movement in space, 
lying. 
Sex Designation Classification 

1. Human seen as male. (a) No reason given. 
(b) Secondary sex characteristics given, e.g., cloth- 
ing, shape. (c) Primary sex characteristics given. 
(d) Both primary and secondary sex characteristics 
given. 

2. Human seen as female. (a) No reason given. 
(b) Secondary sex characteristics given, ¢.g., cloth- 
ing, shape. (c) Primary sex characteristics given. 
(d) Both primary and secondary sex characteristics 
given. 

3. Vacillation. 
versa. 

4. No sex designation. No indication of the sex 
of the figure seen is presented in the response. 


Sees male, then female, or vice 


Scoring Procedure 


Every M response in the subject’s Rorschach: 
record is scored fer the presence or absence of 
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each of the subcategories defined and grouped 
above. Thus the scores on these subcategories 
used for statistical purposes are the sum of the 
subject’s scores on each subcategory for all of 
his M responses. For example, Subject X’s 
score on the subcategory Body a (much expen- 
diture of energy with the total body) would be 
the sum of all of X’s M responses in which the 
person was seen as expending much energy with 
the total body. Similarly, his score on subcate- 
gory Type a (expression of aggression) is the 
sum of all his M responses in which the expres- 
sion of aggression appears. Obviously, the sub- 
categories can be combined into groups and 
scores can be obtained for the groups, as, for 
example, the total number of Male designa- 
tions. Subject X’s score here would be, of 
course, the total number of M responses in 
which he designated the sex as male, 


Reliability of Scoring 


In order to obtain some measure of the relia- 
bility of the scoring, a sample of the records 


Table 1 
Rho Coefficients for Interscorer Reliability 
M Subcategory Rho M Subcategory Rho 
Body a 849 Type b 799 
Body b -700 Type c 618 
Body c 621 *Type d — 
Total Body 889 Type e +555 
*Limbs a ects Type f 691 
Limbs b .363 *Type g sere 
Limbs ¢ -610 Direction a 612 
Total Limbs .524  *Direction b 
Face a 705 = *Direction ¢ 
Face b 675 *Direction d 
Face ¢ -597  *Direction e 
Total Face .627 Direction f 
Objects a 915 Male a 821 
Objects b 453 Male b 923 
*Objects c eee *Male c pen 
*Objects d =- *Male d Leia 
Objects e -.083 Total Male -863 
*Objects f a Female a 741 
People a .875 Female b 403 
People b -665 *Female c is 
People c -572 #Female d moa 
People d 284 Total Female 855 
Type a +524 Sex-Vacillation 1.000 
Sex-No desig- 
nation -782 


> * Omitted from study [1] because of insufficient fre- 


Sioa of occurrence in sample to permit statistical ma- 
nipulation. Hence, omitted here. + 
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from the study [1] was given to five clinical 
psychologists whose Rorschach training and ex- 
perience roughly paralleled that of the author. 
Prior to the “test scoring” 2 trial records were 
chosen, 1 being a long one, 1 a short one. Each 
scorer was trained by the author in the scoring 
of the above subcategories of M on these 2 
records, and the results of their scoring here 
were not included in the reliability study. Sub- 
sequently each individual scored 3 different 
Rorschach records, selected in random fashion. 
Thus there were available two sets of scores 
for each of the 15 Rorschach records: one ob- 
tained by the author and the other by one of 
the scorers referred to above. Rank-order coef- 
ficients were computed between the author S 
scoring and the scoring of the other psycholo- 
gists for each of the M subcategories. Table 
presents the results. 

When the rho coefficients of Table 1 are 
converted into r’s and the significance is C00 
puted, 5 of them fall below the 5% level © 
significance (rho of .480) and 10 below the 
1% level of significance (rho of .60). How- 
ever, 23 of the 33 relationships yield sig™” 
cances beyond the 1% level, thus indicating 
that moderate agreement can be obtaine 
among scorers who have had only a minimum 
amount of training. 


The Experimental Results 
potheses 


T ji j ralized hy 
The following two generalized hy ting 


were constructed for purposes of investiga o 
the relationships between the subcategories 
M and personality characteristics: (4) ene 
various subcategories into which the M respa 
ses may be subdivided are differentially re rion- 
to various categories of intellectual func nses 
ing; (b) various categories of M oe rn 
show significant relationships to different “ 
gories of emotional behavior. 


hypotheses were 121 males who ees 
graduate students in clinical psyc college 0 
ing graduated from a recognize 
university, and specially selected, 3 
group of applicants, for training ere m for 
ans Administration Training Loe à i 
Clinical Psychologists. These su J oie k a 
studied intensively for a period © 
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Ann Arbor, Michigan, during the summer of 
1947, as part of the Veterans Administration 
Assessment Program for Clinical Psycholo- 
gists. During this period they had been given 
many objective, projective, and situational 
tests, and they were subjected to intensive in- 
terviews. There were also available records of 
scholastic achievement and letters of recom- 
mendation. Upon the basis of all of these data, 
each subject was rated by a staff of experienced 
clinical psychologists and psychiatrists on @ 
number of intellectual and emotional traits. 
These ratings are taken as criteria in our study, 
since we consider them to be reasonably valid 
measures of what the subjects were like at the 
time of assessment. 


Procedure 

1. The 121 Rorschach records were scored 
for M according to procedures outlined by 
Beck [2] and for the subcategories of M ac- 
cording to our new classification system. 

2. The frequency distribution for each M 
subcategory was prepared, and the means and 
standard deviations were computed for each. 
Fourteen of the 47 subcategories had to be 
omitted from the study at this point because of 
insufficient frequency of occurrence in our 
sample (less than 5 cases per cell) for use of 
the chi-square technique. 

3. Frequency distributions were made, 
means and standard deviations were computed 
for the ratings of the 121 subjects on the vari- 
ous intellectual and emotional traits. 

4. The two generalized hypotheses above 
were restated in terms of the individual sub- 
Category classifications and the individual rat- 
ing-scale items, the subhypotheses thus con- 
Structed being designed to test the generalized 
hypotheses. 

5. The Rorschach variables were divided in- 
to two or three categories: (4) high and low, 
with the division as near the mean as possible 
(approximately 50% in each group) ; (b) 
high, medium, and low ( approximately 33- 
1/3% in each group). These divisions were 
made according to the ibution of the scores 


and 


distri 
for each variable. The ratings on the various 
traits utilized as our criterion variables were 
similarly divided, but only' into high and low 


3This program is described in detail by Fiske [4], 
Kelly [5], and by Kelly and Fiske [6, 7]. 
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categories, with their division as near thẹ mean 
as possible, dependent upon the shape of the 
distribution. 

6. Chi squares were then computed for the 
various M subcategories and the various rating- 
scale items, the chi squares computed being 
chosen to test the hypotheses presented above. 

7. Scattergrams were plotted for all of the 
relationships computed in Step 6 that had a p 
value of less than .20, and the shape of the 
curve was noted. 

8. Pearson r’s, or etas, dependent upon the 
shape of the curve in the scattergram, were 
computed for all the relationships shown by the 
chi square to have a p value of less than .20. 


Table 2 


Level of Significance of the Correlations with 
Intellectual Variables 


e Ë wis 

„è 2 2 Fy pi? 

38 gio 5 83 È SEn 

aE Bs 2 8288 
Body a a os 01 OL* 
Body b 205 we W 
Body ¢ os O01 OL? 
Total Body .01* 01 .01* 
Limbs ¢ aa- 
Total Limbs 5 
Face a -n 
Face b a .05 
Face ¢ on a+- 01 05 
Total Face aes 05 01 01 
Object a .01* .01*} .01 .01* 
People a 01 .01* = .01 .01* 
People b = 8 .01* 
People ¢ A a = 01 
Type 4 ~ 7 h 
Type b wa dini 
Type ¢ -05 .01* 
Type e a ~-=- a= 
Type f as 05 
Direction @ oni ‘ied mr: ie 
Direction 01 01 
Male a 01 01 
Male b ro 05 
Total Male 01 01* 
Female a we ta 
Total Female 01 
Sex-Vacillation yas, oN es ies 
Sex-No designation 01 01* = .05 .01* 


Sex-No designation = = v 
* Correlation with R partialed out is signific: 

5% level or better. ant at the 
+ Correlation with M partialed out is si 

5% level or better. ignif vant at the 
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This ż value was chosen as an arbitrary limit 
for further exploration since it was believed 
that when the chi square p values were higher 
than .20, the probability that a significant cor- 
relation existed was very small. 

9. To rule out the effect of the total num- 
ber of responses, R, and the total number of JZ 
responses on the results, partial r’s, partialing 
out the effect of R and M, respectively, were 
computed for all relationships shown by Step 8 
to have a correlation significant at the 5% 
level or greater. 


Results 


1. Relationships Between M Subcategories 

and Intellectual Functioning 

Table 2 presents the results relative to the 

relationships between the M subcategories and 

intellectual functioning. Here the hypothesis 
cannot be rejected. Fifty-two of the 112 (zero 
order) correlations of the subcategories with 
the intellectual variables are significant at the 

5% level or better. Eight of the 28 subcategor- 

ies are significantly related to “Broad Inter- 

ests”; 12 of the 28 are significantly related to 

“Imaginative” ; 13 are significantly related to 

“Independent Minded”; and 19 of the 28 are 

significantly related to “Quality of Intellectual 

Accomplishments.” Nine of the subcategories 

are not significantly correlated with any of the 

intellectual variables.* 

The subcategories of M, then, are differen- 
tially related to the intellectual variables, They 
tend to correlate with these variables indepen- 
dently of R, but are not independent of R with 
respect to “Independent Minded.” Nineteen of 
the 52 relationships significant from zero-order 
correlation remain significant when the effect 
of R is held constant, but none of these involves 
a relationship with “Independent Minded.” 
These partial correlation coefficients range 
from .175 to .601, accounting for from 3 to 
36 % of the variance. 

; It is questionable whether M should be par- 
tialed out, as is R, since a score on M inevi- 
tably means a score on a subcategory. However, 
when M is partialed out, we find that the sub- 
categories are independent of M in their predic- 
tions in only two cases, which could have occur- 

*These are: Limbs ¢, Total Limbs, Face a, Type 


a, Type h, Type c, Direction a, Female a, and 
Pacillation in Sex Designation. 
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red by chance. 

Since less than 506% of the subcategories of 
M are independent of R in their predictions of 
the intellectual variables and only two are inde- 
pendent of AZ (which could have occurred by 
chance) in these predictions, it seems that the 
subcategories are not promising variables for 
the clinician to rely upon in assessing intellect- 
ual abilities. 


2. Relationships between M Subcategories 
and Emotional Variables 


The hypothesis that the various subcategories 
are differentially related to various emotional 
variables is not substantiated. Only nine of 132 
correlations are significant at the 59 level or 
better, and only 1 significant at the 19% leve 
or better. This is hardly above chance expec- 
tancy, since it would be expected that approxi- 
mately 7 out of 132 correlations would be 
significant at the 5% level or better by chance 
alone. Only 4 of the relationships are independ- 
ent of R, and 2 independent of M. These cot- 
relations could have been obtained by chance. 


It may be argued that these low correlations 
were obtained because of low reliabilities 1% 
the criterion traits. However, Kelly and Fiske 
[7] and Tupes [11] present data on the relia- 
bilities of the ratings. Estimated indexes © 
reliability of the individual rating-scale itens 
utilized to test the above hypothesis are as f° 
lows: 80, .89, 81, .85, 84, .79, .79, .90, 8 
-84, .88. Thus it does not appear that the lo é 
correlations obtained can be explained on a 
grounds of low reliability of the criterion daté 


P the 

It may be that the possible selection o! z 
population on the personality variables does E 
offer an optimal situation for an adequate A 


of the hypothesis. Nevertheless, it a F 
that one is not justified, with the type © type 
jects utilized in this study and with ae in 
of classification of J responses employ re- 
concluding that the subcategories of A tigate 
lated to the emotional variables inves 


here.® 
; vs: 

s « diness to Coopera oys- 

5The variables are: “Readiness jssive” i Sy, 


ia . m. 1 
Obstructiveness” ; “Assertive vs- Lg elf-centered' 5 
picious vs. Trustful”; “Generous VS: i 


> oise? a] 
me ally P ja 
“Cautious vs. Adventurous”; “Socials pei 


ive ax 
Socially Clumsy”; “Frank vs. Seer Emotional Eo 
Adjustment”; “Appropriateness © of Inner 
, 


“Characteristic Intensity 


ae ete 
pression” ; | Adjustment. 


tional Tension”; and “Sexua 
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Implications 


1. M Subcategories and the Intellectual 
Variables 


Study of Table 2 shows some interesting re- 
lationships and provides for some speculations, 
to be investigated experimentally at a later 
date. 


First, the Body subcategories correlate sig- 
nificantly with the intellectual variables in 12 
out of 16 cases. Yet the Limbs subcategories do 
not correlate significantly with any, and the 
Face subcategories correlate significantly with 
only 6 of the 16. It is hypothesized that the 
Limbs, in particular, and also the Face subcate- 
gories represent something very personal to the 
subject, have very personal meaning for him. 
Hence, projection of M here is less related to 
intellect than projection of M into the total 
body, and more related to emotional factors. 
Along the line of this speculation, it is perti- 
nent to note that in correlations between the 
subcategories and the emotional variables, the 
Body subcategories correlated significantly 
With 2 of the 18 variables tested whereas the 
Limbs subcategories correlated significantly in 
3 of the 9 relationships tested. 


Of greater interest, perhaps, is the following 
Set of observations: the correlation of Object 
a and People a (where there is no interaction 
with objects or people in the environment) 
with the intellectual variables is significant in 
all cases, whereas the correlations of the other 
Interaction classifications are not significant 1n 
all cases ; the Cooperation interaction correlates 
Significantly with three of the intellectual vari- 
ables, whereas only one other Type subcategory 
(Lecturing) correlates significantly with any 
of the intellectual variables and that with only 
one (“Quality of Intellectual Accomplish- 
ments”); the No Designation of Sex subcate- 
gory correlates significantly with all of the 
intellectual variables, whereas Vacillation in 
Sex Designation correlates with zone, and 
designation as Female correlates with only one 
(“Quality of Intellectual Accomplishments”). 
The hypothesis growing out of these data is 
that the person who functions well intellectu- 
ally is the one who isolates (in the Freudian 
sense) intellect from emotion ; that is, emotion- 
al conflict, when not isolated, impairs intellec- 
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tual functioning. The “isolator” would: not be 
concerned with interaction with objects or 
people, and hence is not particularly concerned 
regarding the sex of the person seen on the 
Rorschach nor with highly emotionally charged 
interaction, projecting only “cooperation.” 

A third hypothesis growing out of the data is 
based on the fact that there is more significant 
correlation between the designation as Male 
and the intellectual variables than there is with 
the other sex-designation subcategories. The 
suggestion is that the man who gives much 
Male designation over the other sex-designa- 
tion subcategories, does so because he has 
worked out a good masculine identification, 
and in many ways then can be said to be “better 
adjusted” than those males who have not 
worked out a good masculine identification. 
Hence, he is able to utilize his intellect more 
effectively. 


2. M Subcategories and the Emotional 
Variables 


Since the correlations are little above chance, 
it does not appear that it is possible, at the pres- 
ent time, to utilize the various subcategories of 
M employed here as measures of the emotional 
traits investigated. Perhaps these subcategories 
are related to some of the traits not investigat- 
ed here. Perhaps, also, some combination of 
these Rorschach variables will be good predic- 
tors of these emotional traits. But, at the 
present stage of investigation, it seems to be 
a very dubious procedure for the clinician to 
utilize the subcategories utilized here as meas- 
ures of the emotional variables tested here. In 
the event of lack of evidence concerning the 
relationship between other types of subcategor- 
ies of M and other emotional traits, the nega- 
tive results here emphasize that the clinician 
should be doubly cautious about making inter- 
pretations from M subcategories. It is true, of 
course, that the clinician may obtain clues to be 
investigated with other Rorschach data and 
with other clinical data, as he does with many 
other clinical hunches. But to assume that there 
is anything like a one-to-one relationship be- 
tween the M subcategories and emotional vari- 
ables, or to assume that the AZ subcategories 
have any clear validity as measures of emotion- 
al traits, seems to be an extremely Lazardous 
procedure. 
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Summary 


1. The necessity for experimental verifica- 
tion of hypotheses regarding the interpretation 
of various types of human movement responses 
in the Rorschach test is pointed out. 

2. A new classification system for M re- 
sponses, embodying elements of existing sys- 
tems, is developed, in an effort to meet require- 
ments of good experimental work, and pre- 
sented here. 

3. An experimental study of these subcate- 
gories of M is reported, investigating the fol- 
lowing generalized hypotheses: (a) The vari- 
ous subcategories into which the M responses 
may be subdivided are differentially related to 
various categories of intellectual functioning; 

(b) various categories of M responses show 
significant relationships to different categories 
of emotional behavior. 

4. Subjects utilized for this study were 121 
males, beginning graduate students in clinical 
psychology, studied intensively in the Veterans 
Administration Assessment Program for Clini- 
cal Psychologists. 

5. Criteria for the study were the ratings of 
the 121 subjects on a variety of intellectual and 
emotional traits, made by a staff of experienced 
clinical psychologists and psychiatrists. 

6. Results: Hypothesis (a) was substantia- 
ted by the data, although it was discovered that 
the subcategories are not independently related 
to the intellectual variables; hypothesis (6) 
was not substantiated by the data. 

7. Implications of the findings, particularly 
as concerned the clinician’s use of M subcate- 
gories in interpretation of the Rorschach, are 
discussed. 


Received December 22, 1952. 
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Further Investigation of Rorschach Determinants 
Subjected to Factor Analysis 


Harold L. Williams and James F. Lawrence 


Letterman Army Hospital 


Utilizing the Thurstone method of centroid 
analysis, Wittenborn [+, 5] has recently pub- 
lished two studies investigating the patterns of 
Rorschach scores obtained from two groups of 
subjects, college students and psychiatric pa- 
tients. These factor analytic studies were un- 
dertaken to evaluate four basic hypotheses [4]: 
(a) the factorial composition for M will be 
different from the factorial composition for de- 
terminants involving the use of color; (b) the 
sal CF, C, c, and pure diffusion categories are 
so intercorrelated as to yield a factor differenti- 
ated from F, M, and D; (c) there is a produc- 
tivity factor which (d) is involved to varying 
degrees in the several response categories. In 
general the hypotheses were confirmed, and his 
data indicated that FC, considered factorially, 
is more similar to M than to CF and G- His 
Second study revealed some differences between 
the student and patient groups, introducing 
a new factor which the author believed was 
related to mental health. 

It is apparent that Wittenborn’s results 
question the adequacy of certain standard 
Rorschach scoring categories, particularly 
those of movement, vista, texture, and the 


color variables. Since these results, if con- 
firmed, have considerable importance for fu- 
desirable 


ture Rorschach validation, it seemed : 
to conduct a similarly oriented analysis involv- 


ing a different psychiatric population. The 


Present study, the first unit of a research pro- 
lysis of the Ror- 


gram involving factorial ana 

schach, Wechsler-Bellevue and the Minnesota 
Multiphasic Personality Inventory, was de- 
signed to do this. In addition, in this study, 
Wechsler-Bellevue Verbal and Performance 
TQ scores were included to discover whether 
there are Rorschach determinants which cluster 


with a standard measure of intelligence to 
form a separate factor. Rorschach literature 
[1, 2, 3] has suggested that an intelligence fac- 
tor should be most heavily loaded with F, M, 
R and accurate form level. 


Procedure 

Rorschach protocols and Wechsler-Bellevue 
scores of 86 psychiatric patients were selected 
at random from the files of the Clinical Psy- 
chology Section of Letterman Army Hospital. 
These protocols were scored in accordance with 
procedure advocated by Klopfer [1]. The 
Rorschach scores as well as the verbal and per- 
formance intelligence quotients were intercor- 
related, using tetrachoric coeficients. The re- 
sulting correlation matrix was factored by the 
‘Thurstone centroid method. After extraction 
of the fifth factor the residuals were small 
and there was no evidence of common factor 
variance remaining. The centroid factors were 
then submitted to a series of orthogonal rota- 
tions using the criteria for simple structure. 
The correlation matrix, the centroid factor 
loadings, and the rotated factor loadings are 
shown in Tables 1, 2, and 3. The clarity of 
these factors might be improved by oblique ro- 
tation since loadings would then be higher and 
prediction from the scores improved. 


Analysis? 
Factor I’ appears related to productivity and 
pure form, containing high loadings on R, F 


1 Tetrachoric 7’s were used since the short range 
of many of the Rorschach scoring dereemisans 
made the more conventional Pearson r’s undesirable. 

2 Because of the magnitude of the standard enor 
of tetrachoric coefficients and the relatively small N 
in the present sample, it was decided to set a lower 
limit of approximately 40 for a loading to be 
sidered significant. oe 
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Rorschach Determinants Subjected to Factor Analysis 


Table 2 


Centroid Factors 


I ll m wV Y h2 

wW 76 = 25 -21 -20 91 
D 77 39 33 23 07 93 
d 6& 26 -20 26 31 65 
Dd 76 28 09 03 -31 76 
s 27 31 -1 1 -16 38 
66 27 09 02 -18 55 

FM s1 4 37 06 -16 60 
m 51 33 Si 05 -33 74 
k $1 -25 -22 15 09 40 
K 45 -30 26 06 41 53 


FK 23 22 08 -32 30 33 
F 6 3e 47 2 B 2 
4 lio %4 36 23 ~% 
c 60 -27 B 33 29 64 
Cc’ 39 -18 29 10 23 32 
FC & m 5 Q AL 530 
CF 55 =23 37 22 18 57 
c 295 = 25 15 26 52 


DOH Hee eee ee 
QRESRQIARESHHESVMIAMEYNE 
= 
a 


P 14 a 2 g Ù Aa 

R 97 26 -31 15 10 1.13* 

VoIQ 57 -53 -29 -233 -2% 79 
22 PfIQ 69 45 -s3 -33 00 108 


22 PfIQ 69 45 -53 33 % 


th * Communalities above 1.00 are probably a result of 
e small N in this sample and tho large standard error 
of tetrachoric f. 


Table 3 


Iv’ y h? 


1 W aw a A A gpm 
2 D a a 2 3 @ Z 
3 d 6 33 -02 00 34 64 
4 Dd 3 5 5 0% 2 76 
5 8 19 à 2 g eB 
6 30 44 «47 6 A 54 
7 FM 22 15 60 14 37 59 
8 m o 18 74 07 3 73 
9 k 18 54 -16 -15 17 40 
10 K a 6 S <12 20 53 
1 FK 3 g w I a s 
12 F 82 42 o1 -11 15 89 
13 Fe og zg % 5 2 47 
14 c 6 ag 2A 6 2 64 
15 œ 3 A oa G 30 D 
16 FC 3 a g a 52 
17 CF os 36 03 02 6 57 
i g -29 33 -29 —06 49 51 
19 P og -04 15 39 16 21 
20 R g 6o 18 M A a 
21 X 0g -05 -i1 
roo 5 i 13 -16 1.06 


2 ppo w s #8 3 1 e 


D, d, and c. The highest loadings in Factor 
III’ involve movement variables in addition 
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to Dd and FC. Lack of “perceptual control” 
[5, p. 471] seems to characterize Factor V’. 
The finding of this factor in the present 
sample confirms Wittenborn’s impression that 
there are consistent individual differences in 
the degree to which subjects are spontaneous 
or uncontrolled in their perceptual approach. 

Few significant loadings are found on Fac- 
tor IV’, which forces a conservative interpreta- 
tion. It should be noted, however, that the 
loadings in the shading variables, FK and Fe, 
are consistent with Rorschach scoring pro- 
cedures, i.e., scoring shading separately from 
other variables. Factor II’ is of interest in that 
it supports the clinical impression that the 
Rorschach can be used as a predictor of in- 
telligence, a finding which has already received 
support in previous research [2, 3]. It con- 
tains variables which have been utilized by 
Rorschach interpreters to evaluate intelligence, 
namely, W, M, F, FC, andR. The appearance 
of diffuse shading (K, k) in this factor is per- 
haps not surprising, since it undoubtedly re- 
quires higher than average intelligence to 


verbalize such percepts. 


Comparison 

The five factors described above provide ad- 
ditional support for Wittenborn’s four hy- 
potheses. Factors Y, III’, and V’ are similar 
in composition to three of the four factors 
obtained by that author in his psychiatric 
sample. Except for W and K, the fifth factor 
in this analysis is similar to his “perceptual 
control” factor. In the present investigation 
variables W and K appear on Factor IT’, “the 
intellectual factor.” Factor III’ as in his study 
involves the clustering of M, FM, and FC. 
However the appearance of m in this factor 
provides some evidence of a separate ‘“‘move- 
ment” dimension. Factor I’ in this sample is 
similar to the “productivity” dimension found 
in his psychiatric sample. The presence of c in 
this factor is not clearly anticipated in the 
previous studies. However, the factorial com- 
position of ¢ here obtained is similar to that 
found in his second study. The factorial pat- 
tern of FC in the present analysis is also much 
more similar to that of M than to CF and C 
The appearance of FC in conjunction with te 
movement scores further confirms Witten- 
born’s concept that FC is different from the 
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CF and C determinants and is closely allied 
with m, M, and FM in its behavioral implica- 
tions. a 

The shading variables FK and Fc form a 
separate factor. Wittenborn did not obtain 
such a dimension among his scores, and con- 
cluded that shading should not be scored and 
interpreted independently of other variables 
such as color. Factor IV’, then, provides some 
support for the common practice of scoring 
shading separately from other variables, al- 
though it does not demonstrate that fine dis- 
tinctions drawn between the various qualities 
of shading are warranted. Wittenborn’s analy- 
sis also generated a factor composed primarily 
of S and O, which he suggested was related to 
level of mental health. Since O was not scored 


in this set of Protocols, it is not possible to con- 
firm these findings. 


Summary 


The present analysis was undertaken for 
two reasons: (a) to replicate an earlier study 
by Wittenborn on a different population, and 
(4) to discover whether there is an intellectual 
factor among the several scores in a standard 
Rorschach scoring system. 

Twenty Rorschach determinants and two 
Wechsler-Bellevue intelligence scores from the 
protocols of psychiatric patients of Letterman 
Army Hospital were intercorrelated and the 
resulting matrix analyzed by the Thurstone 


centroid method. In the analysis five factors 
are necessary to account for the common factor 
variance as compared to four in Wittenborn s 
two previous analyses. The five factors appear 
to represent the following dimensions: fay 
“productivity,” (b) “movement,” (c) “lack o 
perceptual control,” (d) “shading,” and (e) 
“intelligence.” 

Wittenborn’s original four hypotheses were 
confirmed, as was his hypothesis that FC was 
more closely allied to movement than to color 
determinants. In addition, the appearance of 
an “intelligence” factor supports the belief n 
certain Rorschach determinants covary WIt 
intelligence. 


Received March 25, 1953. 
Early Publication. 
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The Effect of Test Anxiety on Memory Span in 
a Group Test Situation 
Donald Kaye, Paul Kirschner, and George Mandler 


Yale University 


The effect of anxiety on test performance 
has been investigated in several studies in the 
literature. Generally, this effect has been 
demonstrated under the condition of the ex- 
perimental introduction of stress. Williams 
[6] found the stress effect in the performance 
of the Digit-Symbol substitution test and 
Moldawsky and Moldawsky [2] showed a 
decrement on the Digit Span subtest of the 
Wechsler-Bellevue scale [5]. 

In several previous studies [1, 3, 4] an at- 
tempt has been made to show the effect of test 
anxiety level on the individual performance of 
typical intelligence tests. Briefly, a question- 
naire designed to measure specific test anxiety 
was administered to a large group of subjects. 
Two ends — Low Anxiety and High Anxiety 
subjects — of the resulting distribution were 
then tested. Differential results for the two 
groups were obtained on the Kohs Block De- 
sign test [1], the Digit-Symbol test [4], and 
the Mathematical Aptitude test [3]. 

In the study presented here, the effect of 
test anxiety on memory span in a group test 
situation was investigated. Moldawsky and 
Moldawsky [2] have established the effect of 
situational stress on the Digit Span test in an 
individual test situation. This study supple- 
ments their procedure in examining the diag- 
nostic value of a memory span test in differ- 
entiating two groups of Ss whose anxiety level 
has been independently measured. 


Procedure 


Thirty-six students in introductory psychol- 
ogy courses, who had previously taken the 
anxiety questionnaire, described in detail else- 
where [3], served as Ss. Seventeen Ss were 
taken from the lower 13% of the distribution 
of anxiety scores and nineteen Ss represented 
the upper 13% of the distribution. None of 


the Ss knew of any connection between the 
questionnaire and the testing session. 

The 36 Ss were tested, for purposes of con- 
venience, in three groups of 8, 14, and 14 re- 
spectively. At the beginning of a group session 
the Ss were told that the tests they were about 
to take measured the memory component of 
the IQ and that their scores would be avail- 
able afterwards. These instructions were given 
in line with previous findings [4] that only 
under these, presumably anxiety-evoking, con- 
ditions did a differential effect between the 
groups appear. 

The memory span test lasted twenty min- 
utes and consisted of 28 items: 10 items were 
number series varying in length from six to 
ten; 10 items consisted of mixed letters and 
numbers with the same variation in length and 
8 items contained lists of short words (e.g., 
number, nail, white, foot, light, soot) varying 
from six to nine words per list. The Ss were 
required to write down as much of an item 
as they could recall immediately after it was 
read to them. The correlation between the 
memory span test and an alternate form was 
.82 (Pearson r) for the 36 Ss. 


Results 


The tests were scored for the number of 
correct reproductions. The mean score of the 
Low Anxiety group was 142.4, for the High 
Anxiety group 127.9; the ¢ value of 2.37 is 
significant at the .03 level of confidence. 

This result bears out two main points: 

1. A memory span test significantly differ- 
entiated two groups with differential levels of 
test anxiety as measured by an anxiety ques- 
tionnaire. The Low Anxiety group performed 
significantly better than the High Anxiety 
group. 

2. The differential effect of anmety levels 
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operate: in group situations as well as in- 
dividual testing situations when ego-involving 
instructions are. given. 
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Neurocirculatory Reactions and a Group Stress 
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George B. Strother and Donald M. Cook * 
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Abel [1] found that differences in the recall 
of incompleted and completed tasks by adoles- 
cents were related to differences in the Schnei- 
der index of autonomic efficiency. Her findings 
showed that subjects with good autonomic 
function as indicated by Schneider indices of 11 
or higher recalled more incompleted tasks and 
fewer completed tasks, whereas subjects with 
low indices (0-6) recalled more completed 
tasks. Stagner [4] interpreted these findings 
as indicating that the low-index group responds 
to interruption as a failure situation leading to 
repressive forgetting, whereas high-index sub- 
jects respond to interrupted tasks as a challenge 
and tend to recall more of them than of the 
completed tasks. 

The purpose of this study was to perform a 
parallel experiment using an obviously frustra- 
ting test situation instead of the Zeigarnik ex- 
periment. 

The frustrating test situation selected was 
McKinney’s “reporting test” [2] described be- 
low. Since it was demonstrated by McKinney 
that this situation produced marked individual 
differences in response to the experimental 
stress, the problem was to determine whether 
these differences were related to the subjects’ 
Schneider index. 


Procedure 


The subjects. The subjects were 46 college 
students enrolled in an introductory course in 
Psychology. 

The “index of autonomic efficiency.” The 
Schneider index [3] is designed to determine 
the efficiency of autonomic regulation of mild 
cardiovascular stress by assigning point values 


1The authors are indebted to Dr. Fred McKinney 
of the University of Missouri for the use of the 
k . . 
‘reporting test” materials. 


to pulse rate and blood pressure readings and 
changes, when reclining and standing, and at 
intervals following exercise. 

The reporting test. The test is divided into 
three parts: in Part 1 subjects work for 8 min- 
utes without interruption reporting the num- 
bers of each of three different kinds of objects 
contained in a series of circles. Then for 16 
minutes they are compelled to perform the 
same task against impossible time limits. They 
are frequently interrupted and told to mark 
“failure” (F) on that portion of their work. 
Finally, they work again for 8 minutes without 
interruption. The scores employed in this study 
were those recommended by McKinney as be- 
ing most significant—the differences between 
the percentage correct in Parts I and III, re- 
spectively. 

Results 


Table 1 has been arranged to parallel, as 
nearly as possible, the summary of Abel’s data 
as presented in Stagner [4, p. 327]. It can 
readily be seen by comparing the two tables 
that the results are in striking agreement. The 
majority of high-Schneider subjects in Abel’s 


Table 1 


Autonomic Function and Response to a 
Frustrating Situation 


Reporting-test reaction, 
percentage of cases showing 


Schneider index 


in errors 
(-38 to -9) 


Marked 
increase 
No inerease 
or decrease 


in errors 
(0 to 10) 


a 
High (11-17) 32 41 27 22 
Medium (7-10) 41 41 18 17 
Low (0-6) 72 28 0 7 
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study remember more interrupted tasks; in the 
present study more high-Schneider subjects re- 
spond to the reporting-test situation by showing 
no loss or actual gain from Condition I to Con- 
dition III. Conversely, in Abels study the 
majority of low-Schneider subjects remember 
more completed tasks; in the present study, the 
majority of low-Schneider subjects show sub- 
stantial loss under Condition III. 

Table 1 was planned to permit direct com- 
parison with Abel’s results.. As one conse- 
quence, the number of cases in the low-Schnei- 
der group is small. The present group of sub- 
jects, possibly because of age or some other fac- 
tor, tended to have a higher average than 
Abel’s adolescents. In order to test whether the 
results so presented did represent a genuine re- 
lationship, a product-moment r between re- 
porting-test scores and Schneider indices was 
computed. Table 2 gives the means, standard 


` Table 2 


Relationship between Schneider Index and 
the Reporting Test 


Variable Mean SD r $ 
Reporting test -8.75 10.09 

-30 05 
Schneider index 10.46 3.38 


deviations, and the intercorrelation of the re- 
porting test and the Schneider index. The co- 
efficient of .30 is significant at the .05 level. 


Discussion and Summary 


Numerous physiological factors have been 
suggested as having some relationship to vari- 
ous personality variables. The autonomic nerv- 
ous system has been the subject of a fair share 
of such speculation and investigation. It has 
seemed plausible to assume that such character- 
istics as emotionality, nervousness, excitability, 
or lability might be related to individual differ- 


4. Stagner, R. Psychology of pers? 
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ences in the excitability of the autonomic 
nervous system. Much of the theoretical and 
experimental work dealing with the concept of 
frustration ‘tolerance seems to assume the exist- 


“ence of a generalized tendency for individuals 


to react characteristically to a variety of threat- 
ening or frustrating situations. Such a general- 
ized tendency might well be at least partially 
the result of individual differences in autono- 
mic excitability or efficiency. Abel’s work seems 
to be in accord with this hypothesis if we as- 
sume ‘that interrupted tasks appear threaten- 
ing or frustrating to some subjects. , 

In order to confirm Abel’s finding, using a 
task which is specifically designed to be distur?” 
ing to the subjects, these experimenters Use 
McKinney’s reporting test on a group of col- 
lege students whose Schneider indices they had 
previously determined. The results: accor 
closely with Abel’s and indicate that there is 4" 
apparently significant relationship betwee? an 
individual’s autonomic reactions and his Te- 
sponse to experimental frustration. he 
Schneider index measures the readiness with 
which the individual makes a neurocirculatorY 
adaptation to moderate physiological stress; t p 
reporting test measures the individual’s ability 
to adapt behaviorally to psychological stres* 
There seems to be a measurable degree of 1° 
lationship between the two. 
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For meaningful interpretations of TAT piós 
ductions reference should be made to normative 
data obtained in a standard fashion from well- 
defined segments of the population. A study by 
Ritter and Eron [9] has demonstrated that 
fantasy is important for personality evaluation 
primarily when it is deviant. This is not to say 
that fantasy content which is common to 
a majority of individuals in a given age and 
cultural group is not important for the under- 
standing of the personality of these individuals. 
However, in order to diagnose an individual as 
primarily maladjusted on the basis of projective 
test responses, account must be taken chiefly of 
the ways in which responses differ from those 
of others in the same age and cultural group. 
It is important that the experimenter not be 
misled in his interpretations by responses which 
seem unusual to the “naked eye” but which on 
more careful investigation are found to be com- 
mon among subjects of similar age and status. 

The results reported here are based on an 
extension to two groups of female subjects of 
a methodology for analysis of TAT stories 
which was developed with some success on male 
subjects [3, 4]. It is a procedure for noting and 
summarizing all the important data ina TAT 
Protocol so that it can easily be compared to 
normative material and significant deviations 
from expected responses can then be indicated. 
This can be done both for responses to individ- 
ual cards by use of what Rosenzweig has 
termed “apperceptive norms” [10] and for con- 
sistencies throughout all 20 cards in a given 
Protocol by using “thematic” norms. Both types 
of norms are here presented. 


Method 


Subjects. The subjects for this investigation 
included two groups of female subjects: Group 
C, 40 female college students enrolled in a 


course in introductory psychology at the Uni- 
versity of Wisconsin ;? Group P, 20 women in 
the third to fifth month of pregnancy and at- 
tending the Obstetrical Clinic of the New Ha- 
ven Hospital.2 The age range of Group C was 
18to 31 with a median of 23 years. The age 
range of Group P was 19 to 35 with a median 
of 24, All the women in group P had IQ scores 
of at least 100 on the Wechsler-Bellevue Scale; 
6 had a college education, 6 high school, and 8 
grammar school only; none had ever seen a 
psychiatrist except in the current investigation, 
and none was judged by the psychiatrist to have 
severely debilitating emotional problems be- 
yond what would be expected in a randomly 
selected normal group. They represented a cul- 
tural cross section of the New Haven popula- 
tion. None of the subjects in Group C had ever 
been or were at that time under psychiatric 
treatment. Since they were college students, it 
is assumed their intelligence was at least nor- 
mal. Culturally they probably represent a more 
highly selected group than the subjects in 
Group P, although they did come from all sec- 
tions of the country. 

Procedure. The Thematic Apperception 
Test was individually administered to all sub- 
jects in a standard manner described elsewhere 
[3]. All 20 cards recommended for adult 
females by the authors of the test [8] were in- 
cluded. 

Analysis of data. Each story was analyzed 
for emotional tone, outcome, themes, identifi- 
cation of characters and objects, perceptual dis- 
tortions and unusual formal characteristics. 


1 These subjects were included in an investiga- 
tion by Dr. Dorothy Terry [11], to whom thanks 
are expressed for use of these protocols. 

2 These subjects were being studied in connection 
with research on natural childbirth [6] in which 
the author participated and which was under th 
direction of Dr. Lawrence Freedman, Š 
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Only one variable was rated or scored at a time 
and all the stories for a given picture were rat- 


ed together. 
The scales for emotional tone and outcome 


are the same as those used in previous studies 
where they were described, their construction 
was discussed, and their reliability was estab- 
lished [3, 5]. A further check was made on 
reliability of the scales in this study since dif- 
ferent individuals made the ratings.* Two-hun- 
dred stories, selected randomly from protocols 
of all the subjects, were rated by two psycholo- 
gists for emotional tone and outcome. The 
Pearson r between raters for emotional tone 
was .86 and for outcome was .75. These coeffi- 
cients are comparable to those established in the 
original studies and it would seem thus that 
this is the order of reliability of these scales, 
regardless of the individuals making the 
ratings. It was necessary to add an additional 
category, x, to the rating scale for outcome to 
cover those stories in which no outcome was 
given, or which were mere descriptions with no 
action taking place. In the original study there 
was no provision for such a category since the 
subjects were always asked to supply an out- 
come for each story whenever it was omitted. 
An attempt was made to use directly the 
thematic check list devised for the original 
study with males [2]. It soon became apparent 
that the identical list could not be used for both 
sexes. In the first place, eight of the cards 
recommended for females are different from 
those used with male subjects, and new themes 
had to be introduced; also some of the old 
themes were not applicable. More important 
than this, though, was the fact that the original 
list had been drawn up from the point of view 
of a male hero since it was assumed that the 
male subjects would identify with the male 
characters in the story most like himself in age, 
etc., as suggested by the authors of the test [8]. 
Logically, this list could not then be used with 
female subjects if it is assumed that in general 
they would in the same way identify with fe- 


3 Mrs. Ruth Straatsma rated all the stories for 
emotional tone, and Mrs. Margaret Ingram rated 
those stories used in the reliability estimate. Mrs. 
Sophie „Dutton rated all the stories for outcome, 
ma reliability was checked with ratings made by 
she author, The author analyzed all stories for 


$ ae 
hemes, unusual formal characteristics, and per- 
ceptual distortions. 
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male characters. However, for many of the 
cards it seemed that the central characters 10 
the stories told by a majority of the female sub- 
jects were males. This was especially true for 
cards 4 and 13 MF, both of which contain a 
male and a female figure. To check on this, tW? 
female experimenters went through all the re- 
sponses to these cards and made judgments as 
to which character in each story seemed to be 
the central one from whose point of view the 
story took shape. Percentage agreement as to 
choice of central character was 9+ and each €x- 
aminer selected the female character as centr 
in 26% and 28% of the stories for card 4, ye 
in 4% and 6% of the stories for card 13ME. 
This result is similar to that obtained in an une 
published study by Cohen [1] in which 
women subjects were asked who the centr? 
character was in their stories. For card 
found that 80% of these female subjects 
the male, 20% the female, and for card 13 1 
86% chose the male and 149 the fem@ - 
Thus it seemed that with female subjects 
check list had to be used which was not draw? 
up from the point of view of a hero or hero! 
at least insofar as the heterosexual situation 
was concerned. Consequently the old check lis 
was revised and Table 1 sets forth this © 
check list for thematic analysis. 


chose 
E, 


Table 1 is 
Check List of Themes for Analysis of Wome” 
TAT Stories 
I. Disequilibrium (tension) 
A. Interpersonal 

1. Parent ve pron 
a. Pressure—parent or parent figures A hing 
hibitive, compelling, censurin& R dis” 


hecking “R ing 


disapproving, interfering, © 
Pp a ith, rest 


agreeing with, quarreling W 
or unduly influencing child. 
aa. Child is exerting pressure © 
b. Succorance—child seeks or Te a 
advice, consolation from paren’. adv? 
c. Nurturance—child bestows ie o g of 
aid, consolation to the en jnflict® 
d. Aggression from—physical 


n parent, help 
* ala, 
ceives 


z p t. in” 
intended upon child by parent picted or 
e. Aggression to—physical ids rental 
tended upon parent by ica leave f pa 
f- Departure—child is pe sical of 
home, runs away from rried OVE hy 
o; 


g. Concern—parent is W ild. 
mental well-being of ch! 


Responses of Women to 


Concern—child is concerned over parent. 
Incest. 


actual or contemplated. 

Death or illness of parent. 

Death or illness of child. 

Disappointment to—parent is disappointed 
in child’s behavior or accomplishments. Par- 
ent rejects child. 


Disappointment in—child is disappointed by 
parent, ashamed of parents, derogates parent, 
rejects parent. 

Filial obligation—child feels it is his duty to 
remain with, comply with, or support parents. 
Confession—child tells parent of some mis- 
demeanor or crime he has committed. 
Confession—parent confesses to child. 

Bad news—child brings sad tidings to par- 
ent (eg, death of other parent, brother, 
ett). 

Bad news—parent brings sad tidings to child. 
Marriage—child tells parent of past or im- 
pending marriage, parent objects to marriage, 
interferes with marriage. 

Collusion—parent and child are planning or 
executing together some antisocial act. 
Parental conflict—child is concerned over 
marital problems of parents. Parents disagree 
over child care, etc. 

Lost—child has been abandoned by parents 
or is lost. 

Facts of life explained to child by parent. 
Parent tells child a sibling is coming. 
Parent is jealous of child. 


2. Partner (husband, sweetheart, opposite sex peer) 


a, 


b. 


a 


Pressure—heroine and partner are quarrel- 


ing, can’t agree. 
Nurturance—male character bestows Or offers 
to partner aid, consolation, advice, etc, OT 
these are being sought by female. p 
Succorance—male character seeks or receives 
aid, comfort, consolation, assistance from 
partner, advice from partner. 
Aggression from female character—p 
harm inflicted upon or intended for partner 
by female. i 
Aggression from male character—physical 
harm inflicted upon or intended for partner 


hysical 


by male. 
Departure from—m: 
ner either temporarily or permanently. 
Departure from—female character leaves 
partner either temporarily or permanently. 
Concern—male character is worried over 
physical or mental well-being of partner. 
Concern—female character 18 worried over 
physical or mental well-being of partner. 
Illicit sex—extra- oT premarital heterosexual 
relationship, nonincestuous, includes “pet- 
ting.” 

Illicit sex with violence—rape. 

Death or illness of female partner. 


ale character leaves part- 


ji. 
k. 


Me 


T. 


SS. 


te 


ye 
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Death or illness of male partner. š 
Disappoiniment—male character is disap- 
pointed in female's behavior, or accomplish- 
ments, rejects female, derogates female. 
Disappointment—female character is disap- 
pointed in male’s behavior, or accomplish- 
ments, derogates male, rejects male. 
Jealousy—female character is jealous of part- 
ner’s attention to others or other's attentions 
to partner. 

Competition—male character is jealous of 
partner’s attention to others or other's atten- 
tion to partner. 

Unfaithful—male character discovers partner 
has been having extramarital relations or 
finds her raped. 

Unjaithful—temale character discovers part- 
ner has been unfaithful. 

Decision—male character must choose be- 
tween marriage and not or between two part- 
ners. 

Decision—female character must choose be- 
tween marriage and not or between two part- 
ners. 

Pursuit—male character is wooing or trying 
to get partner to submit, wants contact with 
other sex. 

Seduction—female character is actively pur- 
suing or talking male into relationship, wants 
contact with other sex. 

Unrequited—male character’s love is unre- 
turned, impotence. Waits for partner. 
Unrequited—female character's love is unre- 
turned, is “done in” by partner. Waits for 
partner. 

Restraint—central character and partner can’t 
be married or have intercourse (because of 
economics, deformities, menstrual periods, 
etc.)- 

Childbirth—pregnancy. 

Surprise—female character surprised by part- 


ner. 


3. Peer 


a 


Pressure—like-sexed peers are prohibitive, 
compelling, censuring, punishing, disapprov- 
ing, interfering, restraining, etc. 
Succorance—central character seeks or re- 
ceives aid, advice, consolation from peer. 
Nurturance—central character bestows or of- 
fers aid, advice, consolation upon peer. 
Aggression from—physical harm inflicted 
upon or intended for central character by 
peer. 

Aggression to—physical harm inflicted upon 
or intended for peer by central character, 
Desertion—central character has been de- 
serted by his companions or is lost from 
them. 

Concern—central character is worried about 
physical or mental well-being of friends. 
Homosexuali:y—actual or contemplated. 
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i. Death or illness of friend. . 

j- Belongingness—desire expressed to be with or 
accepted by peers. 

k. Unappreciated by peers. Rejected by peers, 
peers not interested in welfare. , 

l. Competition—central character is competing 
with peer in game or contest, or profession- 
ally. 

m. Hypnotism. 

n. Envy—central character is envious of peer’s 
accomplishments, capacities, belongings, etc. 

nn. Others envy central character. 

o. Revenge—central character is anxious to ex- 
tract revenge from a peer for some past deed 
or is taking the revenge. 

p. Disregard for—central character is uncon- 
cerned over welfare of peers, deserts peers. 

qg. Devaluation of peer—derogation, rejection 
of peer by central character. 


4. Sibling 
a. Pressure—siblings are prohibitive, compel- 
ling, censuring, punishing, disapproving, in- 
terfering, restraining, etc. 
b. Succorance—central character seeks or re- 
ceives aid, advice, consolation from sibling. 
c. Nurturance—central character bestows or of- 
fers aid, advice, consolation upon sibling. 
d. Aggression from—physical harm inflicted 
upon or intended for central character by 
sibling. 
e. Aggression to—physical harm inflicted upon 
or intended for sibling by central character. 
f. Rivalry—siblings are striving for same end, 
are jealous of each other, etc. 
g. Concern—central character is worried about 
physical or mental well-being of sibling. 
h. Incest—actual or contemplated. 
i. Death or illness of sibling. 


B. Intrapersonal 


1. Aspiration—dreaming of future, hoping for fu- 
ture, determination. 

2. Inadequacy—tealization, whether justified or 
not, of lack of success; individual is at a loss 
to cope with situation. 

a. Unrealized. 

3. Curiosity—wondering about construction of ob- 
ject, contents of room, etc., desire to observe, 
inquire, explore, investigate; to acquire facts. 

4, Behavior disorder—personal maladjustment of 
all sorts, neurosis, psychosis, sleeplessness, hal- 
lucination, withdrawal, eccentricity, morbid 
Preoccupation, nightmare, excessive emotional- 
ity. 

5. Suicide—attempted or complete, preoccupation 

with. 

Moral struggle—concern over what is right 

, and wrong, hesitancy in indulging in some act 
because of ethical proscriptions. 

Ts Guilt—remorse, shame. 

8. Drunkenness, 


us 


10. 


k 


12. 


13. 


14. 


15. 


16. 


17. 


18 


19, 


20. 


21 


22. 


23 


24. 


25. 


26. 
27 
28. 
29. 


30. 


si 


32. 
33. 
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Fear-worry—central character is apprehensive, 
alarmed, terrified, of some person, thing, porer: 
Rumination—inability to understand world an 
its problems, adolescent reverie, man’s insig- 
nificance, “what am 1?”, “what's it all ana 
Occupational concern—deciding between jo a 
considering vocations, dissatisfied with presen 
time; worried about 


employment or present pas de 
job. Emphasis on decision which must be ma 
in choosing occupation. 

Physical illness or death of central character— 
(other than when in a peer, partner, ee 
parent relationship, which are included unde 
those specific categories). 
Retribution—forced to atone or be punishe 
some antisocial act. , 
Reminiscence, sad—individual is unhappy a 
his memories of the past or contemplation 
the future, hopelessness 
Intra-aggression—does physical harm tO hat 
short of suicide, (which is carried under 2 m 
heading), either through accident or deliberat“ 
looks forward to own death. 
Religion—prayer, seeking a 
God, religious conflict, religious awakening. is 
Loneliness—central character misses someo" 
an outcast, friendless, homeless. 
Compensation—when individual ha 
acteristic or stroke of fortune to make UP 
another bad characteristic or misfortune dis- 
Vacillation—wasting time, putting off a 
tasteful task, procrastination, loitering, 
for someone unspecified. 
Acquisition—desire expressed by centra 
acter to acquire material things, or is W 


d for 


in 


self 


i om 
consolation fr 


s one char” 


} chaf- 
orking 


> : jserlines* 
greedily for possession of goods; miser oped” 
Exhaustion—characters completely P 
from overexertion. with 


Revenge—central character is preoccupied un 
wish to retaliate for some past wrong, ; der 
specified individual (when peer, carrie 

that heading). 

Inconsequential sadness—over de? 
broken toy, loss of object, ete: +, very $ 
“Hurt Feelings” —central character Fae 
sitive over some happening, slight, ( d- 
Jealousy—of unspecified individual riate hea 
person named, carried under approP 
ing). for 
Self-pity—central character feels 30r nat 
Supernatural—return of the pan charae 
Homesickness—expressed by ee harat 
Physical illness or death of unspe eet, 
(not central character, partner T 
Bored—central character is bore® to 
to do. i 
Regression—central character 
grow up, assume adult respi 
old. i 
Posing—central character — 
Accusation—central character crime 
falsely, of some misdemeano” 


self. 


2 
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C. Impersonal 


Is Economic pressure—individual is compelled to, 
prohibited from, or limited in doing something 
because of the lack of money. 

2. Legal restriction—individual is incarcerated, 
arrested, or detained against his will. 

3. Generalized restriction—environment is gener- 
ally frustrating because of backwardness, dan- 
ger, lack of opportunity, etc.; hopelessness of 
life. 

4. Aggression towards environment—robbery, ac- 
cident, murder of unspecified individual (if in- 
dividual named, carried under the proper head- 
ing). 

5. Aggression from—impersonal source, accident, 

animal, nature, disease, etc. 

War 

Escape from perilous (restricting, shameful) 

environment—individual is in the act of getting 

= (doesn’t include rescue, which comes under 
Ja 

8. Obligation to society 

9. Crime without punishment 


pa 


II. Equilibrium 


A. Interpersonal 
1. Parent 

a. Cooperation—parent is working with child 
towards his own goal. 

b. Resignation—parent is resigned to child’s 
activity. 

c. Idealization—child idealizes parent, wants to 
be like parent. 

d. Reunion—of child with parents. 

e. Fulfillment—child lives up to expectation: 
parents. 

f. Contentment—blissful home situation, 
security of home. 

&. Ordinary familial activity—just talking, 
spending an evening, working, etc. 


s of 


stress 


2. Partner 
a. Admiration 
b. Cooperation—between mates, so that both are 
working for the same end and are happy- 
c. Contentment—mutual love and affection. 
d. Reunion 
e. Ordinary activity 
f. Proposal 
& Anniversary 
h. Dancing 
3. Peer 
a. Cooperation—working to; 
b. Congeniality—sociability, 
factory affiliation. 
c. Reunion—with friends. ° , 
d. A pprobation—central character is lauded, 
appreciated by friends, and peers. 
e. Exhibition—central character is amusing, en- 
tertaining, attracting others. 
f. Ordinary activity—everyday association with 


gether for same goal. 
friendliness, satis- 


nothing in particular happening. ə 
4. Sibling (no II themes found in original sample 
of 200 cases). 


B. Intra. personal 


1. Self-esteem—confidence, belief in own super- 
jority, conceit. 

2. Tranquility—peace of mind, content with en- 
vironment and own accomplishments, enjoy- 
ment, aesthetic appreciation. 

3. Reminiscence, happy—individual is content 
with her memories, or contemplation of future. 

4. Retirement—central character is asleep, resting, 
no physical exhaustion, relaxation. 

5. Occupational satisfaction. 

6. Resignation to Jot—individual accepts situation 
without further struggle. 

7. Ordinary activity—individual is going about 
her everyday activities. 

C. Impersonal 

1. Favorable environment—individual is being 
helped by favorable circumstances, is enjoying 
his surroundings. 

2. Rescue—successful escape from perilous envir- 
onment or cessation of noxious stimuli (already 


accomplished). 


The list of unusual formal characteristics is 
the same as that used in the former studies [3, 
9] under the heading of levels of interpretation 
and includes such things as autobiographical 
stories, symbolic or abstract stories, descriptions 
rather than narratives, denial of popular 
themes, rejections and alternate plots. Percept- 
ual distortions pertain to any marked devia- 
tions from the descriptions of objects and char- 
acters furnished by the authors in the manual 


of instruction [8]. 
Results 


Analysis in these terms (emotional tone, out- 
come, themes, formal characteristics, and per- 
ceptual distortions) are presented for stories in 
response to each card and also for all 20 stories 
in a protocol, so that there is information con- 
cerning what are the common apperceptive 
responses for each card and also an indication 
of how many individuals have a given number 
or more of each kind of response in a total of 
20 stories. In the apperceptive norms, the data 
are presented in terms of percentage of subjects 
having a specific response for any one card, and 
in the thematic norms, in terms of the percent- 
age of subjects having a given number or more 
of these responses in a total of 20 stoxies. Thus. 
by referring to Table 2, for example, it can be 
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seen that 52% of the subjects gave stories with 
emotional tone rating of —1 to card 1; and by 
referring to Table 7, it becomes apparent that 
759% of the subjects contributed seven or more 
stories with emotional tone rating of —1 in a 
total series of 20 stories. Significant differences 
beyond the .05 level of confidence between the 
two samples of subjects were noted. In calcu- 
lating these differences the actual frequencies 
rather than percentage frequencies were used 
in the standard formula for calculating the chi 
square of homogeneity, with Yates’s correction 
where appropriate [7]. Fourfold tables, denot- 
ing presence or absence for each group, were 
utilized in calculating differences in themes, 
unusual formal characteristics and perceptual 
distortions. With emotional tone and outcome, 
where 5 X 2 tables were possible because of 
rating-scale intervals, appropriate cut-off 
points were used so that there would be a theor- 
etical frequency of at least five in each cell. 
Consequently there were a number of 3X2 as 
well as 2 X 2 tables. In the thematic norms, 
which indicate the percentage of individuals 
having a given number or more of any response 
in a total of 20 stories, the chi squares were 
calculated from the actual frequency of indi- 


Table 2 


Percentage Frequency of Subjects Contributing 
Stories of Various Emotional Tone Rating 
for Each of 20 Cards 


Card Emotional Tone Ratings 
—2 —1 0 +1 +2 Reject 
1 6 S52 22 22 5 0 
2 0 48 37 15 0 0 
3GF 38 62 0 0 0 0 
4 12 87 0 0 0 0 
5 3 45 48 3 0 0 
6GF 47 238 25 0 0 0 
7GF 5 23 50 22 0 0 
8GF 22 62 17 0 0 0 
9GF Bo 7 p 2 0 2 
10 B 27 3 43 B 0 
11 13 57 30 0 0 0 
12F 2 23 3 B 0 0 
13MF 77 22 2 0 0 0 
14 3 13 4 42 2 0 
15 47 42,12 0 0 0 
16 2 B 85 37 m 3 
17GF 2 27 B p 0 2 
18GF 43 52 3 2 0 0 
19 5 27 27 40 0 2 
20 7 40 52 i) 0 2 
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viduals having each number of instances 1n 
question. Cut-off points here were also selected 
so that the theoretical frequency of any cell 
would be at least five and there were thus 4 
number of 3 X 2 as well as 2 X 2 tables. 


Table 3 a 
Percentage Frequency of Subjects Contributing 
Stories of Various Outcome Ratings for 
Each of 20 Cards 


Card Outcome Ratings . 
—2 — 0 +1 +2 ? x 
1 325 7 oo ie f i 
2 & i Tf 2 BR 5 r 
3GF 22 27 5 30 5 5 j 
4 3 2 2 35 10 10 i 
5 7 i i 2 7 2 z 
6GF 5 1% Ë B 5 3 a 
7GF 3 B e a7 8 0 z0 
8GF 8 2 2 2 ğ 2 ve 
9GF w 22 12 = 27 3 0 a 
10 e a7 8 13 37 2 a 
11 18 $ 5 30 2 A 
12F 7 23 10 23 10 3 a 
13MF 47 8 3 13 0 8 Pe 
14 2 13 13 40 17 2 Me 
15 23 3 a) 3 5 5 
16 2 8 15 y 17 0 z0 
17GF 2 15 18 22 7 7 t 
18GF 30 15 0 32 3 5 a 
19 3 7 8 27 8 0 23 
20 10 10 18 25 42 3 
Table 4 


pjects 
All Themes Contributed by Two or More Sud) 


for Each of 20 Cards 


Percents 
frequene 

Code Then 

Card 1 > 
IAla parental pressure 37 
IB11 occupational concern 35 
es aspiration oT 
1A3j belongingness 10 
1B2 inadequacy 5 
1B7 guilt-remorse 5 
IC1 economic pressure 3 
IB3 curiosity 3 
1B19 vacillation 

Card 2 m 
IB1 aspiration 27 
IB11 occupational concern 23 
TAla parental pressure 35 
TAim filial obligation. sai 10 
IIAla cooperation with pê E f 
IC3 generalized restrictio : 
IA4f sibling rivalry 


nt 
IAic nurturance to pare 


yt 


i 


IA2r 
HAig 
IC1 
IB7 
IA1f 
IA1i 
TlAle 


Card 3GF 
IA1j 
IA2a 
IA2ss 
TAla 
1B7 
1B29 


IA2f 
IA2jj 
IB17 
TAli 
IB12 


IB24 
IAir 
IA200 
IB2 
IB4 
IC1 


Card 4 


IA2c 
IA2f 
IA2b 
TA2ss 
IA2p 
IA2r 
IA200 
IB2 
IB11 
IC5 
IA2gg 
TA2h 
IB1 
TA2m 
IA27 
IA2g 
TA2s 
TA3e 
IB6 
1B22 
1C6 


Card 5 
IB3 
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seduction 

ordinary familial activity 
economic pressure 

guilt 

departure from parent 
death or illness of parent 
fulfillment, parent 


death or illness of child 

pressure from partner 

unrequited female partner 

parental pressure 

guilt 

illness or death of unspecified 
character 

departure from partner 

death or illness of male partner 

loneliness 

death or illness of parent 

physical illness or death of 
central character 

hurt feelings 

parental conflict 

unfaithful male partner 

inadequacy 

behavior disorder 

economic pressure 


succorance from partner 
departure from partner 
nurturance to partner 
unrequited female partner 
decision for male partner 
seduction 

unfaithful male partner 
inadequacy 

occupational concern 
aggression from environment 
concern of female partner 
illicit sex 

aspiration 

jealousy 

competition 

pursuit of partner 
unrequited male partner 
aggression to peer 

moral struggle 

revenge 

war 


curiosity 

parental pressure 

concern of parent 

fear, worry | 

ordinary activity 
disappointment to parent 
concern of female partner 
aggression to environment 
behavior disorder 


vunnu 


15 


13 


Card 6GF 


IA2a 
IB9 
IlA2e 
IA2q 
IA2r 
IAla 
1B33 
1B7 
IC4 
TA1p 
TA2h 
IA21 
IA200 
IA2y 
IB24 
IA2d 
IAig 


Card 7GF 


IAla 
IAlv 
TAlw 
IA3j 
IA4f 
IB1 
IB7 
IB30 
1B23 
Alg 
IA1b 
IAll 
Aif 
IB3 
IB4 
IB11 
IB16 


Card 8GF 
IIB3 
IB1 
IB11 
IC1 
IIB7 
1B32 
IB21 
IB14 
IB10 
IIB4 
IA1b 
IAig 
1B13 
IB17 
IC3 
IIB2 


Card 9GF 
IC7 


IB3 
IA2m 
IB9 


N 
o 


pressure from partner 
fear, worry 
ordinary activity 
pursuit of partner 
seduction 

parental pressure 
accusation 

guilt 

aggression to environment 
marriage 

illicit sex 

disappointment in male partner 
unfaithful male partner 
surprise by partner 

hurt feelings 

reunion with partner 

concern of parent 


m 
a 


m 
u 


ae 
MwWwWwWWuWwWuuUUWISS 


us 
N 


parental pressure 
facts of life 18 
a sibling is coming 
belongingness 

sibling rivalry 

aspiration 

guilt 

bored 

inconsequential sadness 
ordinary familial activity 
succorance from parent 
disappointment in parent 
contentment with parent 
curiosity 

behavior disorder 
occupational concern 
religion 


eee 
OKwWWWUUUIIHOMOON 


reminiscence, happy 
aspiration 
occupational concern 
economic pressure 
ordinary activity 
posing 

exhaustion 
reminiscence 
rumination 

retirement 

succorance from parent 
concern for child 
retribution 

loneliness 

generalized restriction 
tranquility 


Nw 
ow 


Bee ee 
WwWUWAWWUWUUIAOWUUMN 


escape from perilous environ- 
ment 33 
curiosity 28 
jealousy 22 
fear, worry 18 
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TA3a « 
IA200 
IA4f 
IA2a 
IA2e 
IA2ss 
IA3b 
IC5 
IIA3b 
IA3n 
IA3q 
IA4a 
IA2jj 
IA3c 
IA3k 
IA3p 
IB2 
IB4 
IB5 


Card 10 
HA2 
IA1j 
IA2b 
IA2c 
IC6 
IAlg 
IIA2h 
IIAid 
IA2f 
IC5 
IIA2d 
IIB3 

IIA2g 
IAic 
IA1f 
IA2t 
IIA1b 


Card 11 


IC5 
1C7 


IB9 
TA3e 
IB3 
IB12 


IA3a 
IA3d 
IB4 
IC3 
IC4 
ICi 
IC6 


Card 12F 
TAI 
TAla 
IA1b 
{B14 
IB4 


pressure from peer 


unfaithful male partner 


sibling rivalry 
pressiire from partner 


aggression from male partner 
unrequited female partner 


succorance from peer 


aggression from environment 


congeniality with peer 
envy of peer 
devaluation of peer 
pressure from sibling 


death or illness of male partner 


nurturance to peer 
unappreciated by peer 
disregard for peer 
inadequacy 

behavior disorder 
suicide 


contentment 
death, illness of child 
nurturance to partner 


succorance from partner 


war 

concern for child 
dancing 

reunion with parents 


departure from partner 
aggression from environment 


reunion with partner 
reminiscence, happy 
anniversary 
nurturance to parent 
departure from parent 
restraint from partner 
resignation to child 


aggression from environment 
escape from perilous environ- 


ment 
fear, worry 
aggression to peer 
curiosity 


illness or death of central 


character 
Pressure from peer 
aggression from peer 
behavior disorder 
generalized restriction 


aggression to environment 


economic pressure 
war 


disappointment in parent 


Parental pressure 
succorance from parent 
reminiscence, sad 
behavior disorder 
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vuuan 


w 
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IB7 
1B31 
1B32 
1Alc 
IB9 
IAli 
IA1k 
IAlm 
IC1 
IIB1 
IA1p 
IAig 
IA2m 
1A3q 
1B2 
ICs 
IIB3 


Card 13MF 
IA2j 
IB7 
IA2e 
IA2a 
IC1 
IB5 
IA2h 
IA2i 
IA20 
IA2u 
1B2 
IB+ 
IB11 
IC5 
IA1j 
IB13 
IA2s 
IB6 
IB8 
IB16 
IB21 


Card 14 


IB1 
IIB7 
IB11 
IIB2 
ICi 
IIB3 
1A3j 
TAla 
IB4 
IB5 
IB10 
IB17 
IIC1 
IA2s 
TA2t 
IB2 
IC3 
IC6 


guilt 

regression 

posing 

nurturance to parent 
fear, worry 

death, illness of parent 


disappointment to parent 


filial obligation 
economic pressure 
self-esteem 

marriage 

collusion with parent 
jealousy of partner 
devaluation of peer 
inadequacy 


aggression from environment 


reminiscence, happy 


death, illness of female partner 


guilt 


aggression from male partner 


pressure from partner 
economic pressure 
suicide 

illicit sex 


illicit sex with violence 
unfaithful male partner 


childbirth 
inadequacy 

behavior disorder 
occupational concern 


aggression from environment 


death, illness child 
retribution 


unrequited male partner 


moral struggle 
drunkenness 
religion 
exhaustion 


aspiration 

ordinary activity 
occupational concern 
tranquility 

economic pressure 
reminiscence, happy 
belongingness 
parental pressure 
behavior disorder 
suicide 

rumination 
loneliness 

favorable environment 


unrequited male partner 


restraint from partner 


inadequacy 
generalized r 
war 


estriction 


Pa 
œ 


ga 
wr & 


o 


= 
we 


Bee 
Uuuu uuau oN 


rw 
WY YUNAUNUNUNUNAIAIDAOL 
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intra-aggression 

religion 

death, illness female partner 

death, illness friend 

behavior disorder 

loneliness 

guilt 

acquisition 

reminiscence, sad 

supernatural 

aggression to environment 

death, illness child 

aggression to peer 

unappreciated by peer 

disregard for peer 

ordinary activity 

illness or death of unspecified 
character 

belongingness 

death, illness sibling 

fear, worry 

rumination 


illness, death central character 


contentment, parent 
aspiration 

aggression from environment 
contentment with partner 
congeniality with peer 
parental pressure 
nurturance to partner 
death or illness of parent 
curiosity 

rumination 

fulfillment, parent 
inadequacy 

tranquility 

ordinary activity 


suicide 

ordinary activity 
curiosity 

generalized restriction 
economic pressure 
aspiration 

aggression to environment 
aggression from environment 
unappreciated by peer 
unrequited female partner 
occupational concern 
loneliness 

parental pressure 
nurturance to parent 
unrequited male partner 
nurturance to peer 
behavior disorder 
occupational satisfaction 


UUW o o 


ww wa u u uD 
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Card 18GF 


IA1b 
IAla 
IAlj 
1A3e 
IAld 
1B+ 
Ics 
IA4i 


IC1 
IAli 
TA4e 
1A3i 
IA4c 
IB9 
IAic 
IA1l 
IAlg 
IA3b 
1B7 
IB12 


IA1f 
IA2m 
1A200 
IA4a 
IA4g 
IB3 
IB13 
1B20 


Card 19 
IC5 
IIA1f 
IB27 
IB9 
IB4 
IB3 
IB17 
Ici 
I1A3b 
I1B2 
JA2q 
IA3b 
IB2 


Card 20 
IB19 
IB17 
IC4 
IA3b 
IC5 
IB11 
IB10 
IA2s 
IA3e 
IA3k 
IB3 
IB8 
IB9 


succorance from parent 


e 


parental pressure 
death, illness of child 
aggression to peer 
aggression from parent 
behavior disorder 
aggression from environment 
death, illness of sibling 
economic pressure 
death, illness of parent 
aggression to sibling 
death, illness of friend 
nurturance to sibling 
fear, worry 
nurturance to parent 
disappointment in parent 
concern for child 
succorance from peer 
guilt 
physical illness, death of 
central character 
departure from parent 
jealousy of partner 
unfaithful male partner 
pressure from sibling 
concern for sibling 
curiosity 
retribution 
acquisition 


aggression from environment 
contentment with parent 
supernatural 

fear, worry 

behavior disorder 
curiosity 

loneliness 

economic pressure 
congeniality with peer 
tranquility 

pursuit of partner 
succorance from peer 
inadequacy 


vacillation 

loneliness 

aggression to environment 
succorance from peer 
aggression from environment 
occupational concern 
rumination 

unrequited male partner 
aggression to peer 
unappreciated by peer 
curiosity 

drunkenness 

fear, worry 


VWAAIIAIANUHHBS 
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TA3c nurturance to peer 5 Card 10 
1A3j belongingness 5 II G autobiographical 3 
1B2 inadequacy 5 Ill J comments 2 
IB14 reminiscence, sad 5 Til R reification a 
1C6 war 5 
ILA2c contentment 5 Card at = 17 
I1B7 ordinary activity 3 II C descriptive 13 
IC1 economic pressure 3 Ill D unreal 10 
IB6 moral struggle 3 mi 1 alternate themes 8 
Ill E fairy tale 
Table 5 III G autobiographical : 
Ill R ificati 
Unusual Formal Characteristics Contributed by One ILA — 2 
f symbolic 
or More Subjects for Each of 20 Cards Card 12F 
ar J 
Percentage III D unreal r 
Code Characteristics frequency III I alternate themes 7 
Card 1 ————— es E ran eg 7 
air ale 
II I alternate themes 3 li K dese a 
II G autobiographical 2 I G autobiographical 2 
Ill J comments 2 II R reification f 
Card 2 Card 13MF 
II D unreal 7 III I alternate themes n 
III I alternate themes 3 Ill G autobiographical 2 
Ill G autobiographical 2 NI R reification 
Ill J comments 2 Card 14 
Card 3GF III I alternate themes : 
III I alternate themes 5 Til H continuations 2 
Ill K denial 3 ll G autobiographical 
WIR reification 3 Card 15 
HI G autobiographical 2 II D unreal . 
Card 4 MI F central character not in picture 7 
III D unreal 10 Ill I alternate themes 2 
Ill I alternate themes 5 III C descriptive 2 
li K denial 5 Ill J comments 2 
Card 5 at $ ia ; 2 
III alternate themes 3 i 
Il H continuations 2 Card 16 22 
Ui K denial 2 II G autobiographical 3 
Card 6GF = c pte A 
descriptive ange 2 
III I alternate themes 5 Ill F central character not in pictu®® 9 
UI D unreal 2 i ; 2 
Ill H continuations 
Card 7GF HI R reifications 
III I alternate themes 5 Card 17GF 12 
III G autobiographical 3 HK š 7 
Card 8GF IK denial 3 
MI I alternate themes 3 
II D unreal 3 III A symbolic 3 
Il F central character not in picture 3 IIJ comments 2 
Il I alternate themes 3 II R reification 2 
IIR reification 3 III C descriptive 2 
IIC descriptive 2 IIG autobiographical 
ll H coutinuations 2 Ill L rejection 
Card 9 Card 18GF 
Ill I alternate themes 10 MI I alternate themes 2 
= G autobiographical 2 Ill K denial aii 2 
i © descriptive z Ill G autobiographica 
R reification 2 lll H continuations 
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Card 19 
uD Card 7GF 
me o z 17 girl is holding a baby Š 
III 2 ae 12 uncertain if older woman is holding book 2 
ILE fairy tale 3 Card 8GF 
i 4 comments 5 sexual misidentification 2 
Il 4 central character not in picture 3 Card 9GF 
autobiographical 3 flection i 
Ill I aieevnuté themes 3 a reflection in the water 3 
Card 20 Card 10 
Ill I — *elderly couple 25 
uG pala themes 8 *young couple e 
IIR reifi a 3 mother, son 7 
WIA r eee 3 two males 3 
I x symbolic 2 
uk denial 2 Card 12F 
sexual misidentification (figure in fore- 
ground) 3 
Perceptual Di z Table 6 Card 13MF 
a I ta Contributed by One or More *pudity of woman mentioned 8 
jects for Each of 20 Cards *doctor, patient 7 
ht 
Dissi Peccantune father, daughter 3 
rhon frequency Card 14 
Card 1 individual sitting on window ledge 3 
broken string 3 individual climbing 1n window 2 
boy’s eyes closed 2 Card 15 
Card 2 manacled hands 8 
*pre chairs instead of crosses 2 
LS ately op 8 man in background 2 
ound is girl’s i oe 3 
Ceca SMR girl’s imagination 3 Card 17GF 
woman i sexual misidentification 18 
nan in background seen as real, not Negro character on bridge 5 
fgg te 10 don’t mention character on bridge 2 
baci in foregrouna scen as nurse 5 seen as two different scenes 2 
an in m 
“characters eo aie a pa a Card 18GF 
er and sister me ai ī n 
Card 6GF sexual misidentification 28 
*hus p , Card 20 
He wife (contemporaries) 68 sexual misidentification 3 
“fathe usband 10 no head on man 2 
Satie daughter 7 no character seen 2 
Pi or husband 3 a 
erlo 5 * These are not actually perceptual distorti: 
Oss ck Holmes 2 are in this table in order to furnish O tay 
2 unusual interpretations. 
Table 7 
Percentage of Subjects Contributing in a Protocol of 20 Stories a 
Given Number or More Stories of Each Emotional Tone Rating 
Rating Frequency in 20 stories 
i 2 3 4 5 6 7 8 9 10 un 12 B 4 15 
-2 98 90 73 33 15 5 3 2 
=a 100 100 100 97 92 88 75 60 40 22 15 5 2 2 2 
0 ioo 93 87 80 5 42 33 2 15 8 3 2 2 
+1 10 Z S ar m w T 3 
+2 28 2 
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Table 8 


Percentage of Subjects Contributing in a Protocol of 20 Stories a Given Number 
. or More Stories of Each Outcome Rating 


Frequency in 20 stories 


Rating 1 2 3 4 5 6 vi 8 5 © im 2 m m 
—2 82 60 28 20 12 5 3 3 2 2 2 2 
—1 92 78 53 32 22 10 3 
0 82 67 37 17 10 8 7 3 2 
+1 97 90 83 73 62 45 38 27 15 12 7 5 5 3 
+2 70 38 27 22 13 8 8 5 3 
? 40 13 7 2 2 2 2 2 2 
x 87 77 65 48 38 27 is 17 12 10 $% 5 5 2 
> 
Table 9 partner 18 2 
Percentages of Subjects Contributing in a Protocol of TA2ss unrequited female 
20 Stories a Given Number or More of Every partner 33 7 
Theme Contributed at Least Twice by IA2t restraint 10 2 
Any Subject IA2u childbirth 10 2 
IA3a pressure from peer 27 3 
Code Theme Frequency in 20 stories IA3b succorance from peer 30 5 
1 2 3 4 5 6 IA3d aggression from peer 8 2 
IA i 
IAla parental pressure 87 62 48 20 5 2 e nes Coad s . 
IA1b  succorance from IA3j _ belongingness 47 10 
parent 7 13 3 IA3k unappreciated by peer 33 7 
IAic nurturance to parent 25 3 2 2 IA3n envy 8 2 
IAif departure from IA4c nurturance to sibling 8 3 
parent is 3 IA4f sibling rivalry 28 3 
IAig concern for child 42 15 3 IB1 aspiration 83 52 
IA1įi death or illness IB2 inadequacy 47 15 
of parent 32 8 2 IB3 curiosity 80 45 
IA1j death or illness IB4 behavior disorder 62 12 
of child 45 8 2 2 IBS suicide 47 8 
IAik disappointment to 1B6 moral struggle 17 2 
parent 23 5 3 IB7 guilt-remorse 63 32 
IA1/ disappointment in IB9 fear-worry 60 37 
parent a2 S g IB10 rumination 28 2 
IAim filial obligation 25 3 IB11 occupational concern 42 37 
IA2a pressure from partner 60 22 3 IB12 illness or death of 
IA2b succorance from central character 30 2 
partner 42 12 IB14 reminiscence, sad 37 8 
IA2¢ nurturance to partner 45 12 IB15 intra-aggression 30 2 
IA2f departure from IB16 religion a3 3 
partner m 8 IB17 loneliness 52 22 
IA2gg concern for female IB19 vacillation 43 a 
partner 12 2 IB20 acquisition 20 2 
IA2h illicit sex 35 5 IB21 exhaustion 8 
TA2i illicit sex with 1B22 inconsequential 2 
violence 7 3 sadness A 3 
IA2j death or illness IB27 supernatural a 23 
female partner 75 23 IC1 economic pressure j, 2 
IA2jj death or illness IC2 legal restriction ane 
male partner 23 2 IC3 general restriction 
IA2m competition for IC4 aggression to 45 12 
partner 30 s$ environment 
IA200 unfaithful to partner 30 3 IC5 aggression from gs 53 
IA2q pursuit of partner 18 2 environment 23 8 
TA2r seduction 27 3 IC6 war 50 15 
IA2s unrequited male IC7 escape 


17 


25 


13 


Responses of Women to the TAT 


HAta cooperation with 

Parent 18 3 2 
IIA1f contentment with 

parent 40 8 2 
TlAig ordinary familial 

activity 17 3 
IIA2c contentment with 

partner 50 5 2 
mr reunion with partner 8 2 
IA3b congeniality with 

peers 20 2 
= self-esteem 135 2 2 
ed tranquility 23 5 
Te reminiscence, happy 40 10 2 
a 7 ordinary activity 57 18 g 3 2 
C1 favorable 

environment 23 3 


On only one out of 20 cards was there a 
difference in emotional tone rating between the 
two groups of subjects which was significant 
at or beyond the .05 level of confidence. Table 
nee forth the card-by-card normative data 
or emotional tone. As regards outcome there 
four significant card differences for the 
inear scale of values and no significant differ- 
ences on any card for the (?) category. The 
Outcome data are presented for each card in 
ae 3: In merely 10 instances were there 
ane differences in themes (total possible 
ana ge of comparisons was 150X20=3000) 

he card-by-card normative data appear 1n 

x able 4. There was a significant difference in 

nusual formal characteristics on only one card 

Pa there were no such differences on any 

Single card for perceptual distortions. The 

A naive data for these two variables are 
ound in Tables 5 and 6 respectively. 


Table 10 


Contributing a Given N 


Percentages of Subjects 


Formal Characteristics ina P 
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When the data for all 20 cards wer pooled, 
so that analysis was possible in terms of the 
frequency of individual subjects contributing a 
given number of a specific theme, emotional 
tone, distortion, formal characteristics, etc., in 
a total protocol of 20 stories, the two groups of 
subjects were still found to be quite similar. 
There were no differences in emotional tone of 
the stories, but the pregnant subjects did give 
significantly more happy outcomes than the 
college girl subjects (normative data in Tables 
7 and S respectively). Out of a check list of 
150 themes, on only one do these two groups 
differ—more college girls gave more themes of 
occupational concern than did the pregnant 
women (Table 9). There were no differences 
in unusual formal characteristics (Table 10) 
but more pregnant women produced more per- 
ceptual distortions, excluding sexual misidenti- 
fications, than did the college girls (Table 11). 

From these data concerning significant dif- 
ferences it is apparent that both samples are 
really drawn from the same population insofar 
as TAT stories analyzed according to this 
methodology are concerned, since there were 


Table 11 
ects Having a Given Number 
al Distortions in a Protocol of 
20 Stories 


Percentages of Subj 
or More of Perceptu 


Frequency in 20 stories 


Type of distortion 
12 36 @ & 


50 12 2 
57 32 5 
70 45 12 5 2 


Sexual misidentifications 
Other distortions 
Total distortions 


umber or More Stories with Unusual 
rotocol of 20 Stories 


Frequency in 20 stories 
4 5 6 7 8 9 10 t 


Code Characteristics 1 2 3 
HIA § i 12 3 
ymbolic 
IIIC ‘Descriptive æ ws 2 2? 
HID Unreal 53 18 7 2 
me Fairy tale a ; 
F Central character out 

a a 3 2 
IIG Autobiographical 22 5 3 A 3 : 2 z : £ 
III Alternate themes 45 25 17 10 2 =% g 
IIJ Comments 10 a ; 
IIK Denial of theme 22 7 2 g 
HIR Reification a E a E E, 


ee eee E I AEE AEA 


282 


hardly inore than differences between the two 
groups than would be expected by chance in the 
number of implicit and direct comparisons 
made for each variable. Actually, then, it is 
reasonable to pool these data and offer norms 
based on a sample of 60 “normal” American 
women in this age range. By referring to these 
norms it will be possible to determine whether 
any given story contributed by a woman in re- 
sponse to a particular card is unusual or if there 
is a characteristic consistency throughout a 
series of 20 stories which is outside normal 
limits. These are the basic data—the frequency 
and unusualness of specific fantasy content — 
which must be determined before any interpre- 
tive significance can be placed on the thematic 
material obtained. How any TAT analyst will 
then use these data to interpret personality 
structure and content will depend on his own 
theoretic orientation and on the amount of be- 
havioral data obtained from other sources 
which are available to him and in the light of 
which he can ascribe meaning to the fantasy 
material. 


Received December 11, 1952. 
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leg ere is the second in a series report- 
qualities of lationship between the ambiguity 
sonality fa eg stimuli and extent of per- 
first [2] i ors in the elicited fantasy. The 
lishing ile the method used for estab- 
ception Te iguity values for Thematic Apper- 
Paper to a pictures, It is the object of this 
ship Metin scribe the findings on the relation- 
ppérceptioy, stimulus ambiguity of Thematic 
Sonality lg Test pictures and extent of per- 
Uctions, ors evaluated from fantasy pro- 
a pointed out [2] that a common 
that the in social and clinical psychology is 
Breater hi ambiguous the stimulus the 
Breater Kea apperceptive distortion, hence the 
Vealed Th amount of personality factors Te 
structure F problem of how the stimulus 
tors “q 4 fects the extent of personality fac- 
haves e mag 'a response is central to any 
ulus oe attempting to interrelate stim- 
apperce iguity on one hand, and perception, 
Other Ping and motivational states on the 
show h oe experiments in this area attempt to 
bles) oe inner” factors (intervening varia- 
Tather T a role in perception and apperception 
related an how configurational ambiguity 1s 
tni to „the extent of personality factors 
Jected” into the stimulus situation. 

vided. hypothesis under consideration has pro- 
of part of the rationale for the construction 
the TAT and other projective techniques. 
nd because of the obvious pertinence of this 


ss their appreciation to 
ra Steisel for so con- 
duous task of judging 


T 
es authors wish to expre: 
alent Quinn and Dr. I 
the wivusly performing the ar 
Protocols, 


hypothesis to clinical, social, and personality 
ion of clinical in- 


theory and to the construct 
struments as well, there is a continual need for 


research which aims to evaluate its validity. 
Method 


Ascertaining ambiguity level. The first paper 
[2] in this series may be referred to for a dis- 
cussion of alternative methods for measuring 
the ambiguity qualities of stimulus material for 
obtaining apperceptive responses. We will reca- 
pitulate briefly our approach to the problem. 
Data on the ambiguity of 21 TAT cards (the 
general and male series) were obtained by hav- 
ing 51 judges rank order the cards according to 
our definition of ambiguity. We defined ambi- 
guity level in terms of the estimated number of 
interpretations a group of judges thought 
would apply to each TAT card. An ambiguity 
value for each card was therefore expressed in 
terms of its median rank-order value. The mul- 
ti-judge reliability of the ranking was adequate 
(p=.80). : 

By this method we obtained three sets of five 
TAT pictures each, varying in three degrees of 
ambiguity. Cards 12BG, 1, 2, 9BM, and 17 
BM had low median rank values and are there- 
fore classified as least ambiguous. Cards 4, 7 
BM, 8BM, 12M, and 13 MF were given in- 
termediate rank values and make up the inter- 
mediate ambiguity group. And cards 5, 15, 18 
BM, 11, and 19, which had the high rank 
values, comprise the most ambiguous set. 

Obtaining fantasy responses. The 15 cards 
were administered individually to 18 male col- 
lege students from introductory psychology 
classes at the University of Washington. The 
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subjects were assigned at random to three com- 
parably trained examiners, two males and one 
female. Fantasy. reactions to the cards were 
obtained according to Murray’s [8] procedures 
with certain necessary modifications. In order 
to present comparable test situations, test direc- 
tions were standardized. The experimental 
design required the subject to relate a story to 
each card of a set on three successive days, the 
cards being administered in random order be- 
tween and within sessions. Stories were record- 
ed on a dictaphone machine. Each story was 
then typed on a single sheet of paper and 
assigned a code number. From our 18 subjects 
we obtained 270 stories, 90 for each of the 
three sets of cards. Before being presented to 
the judges, the typewritten protocols were 
shuffled to eliminate the influence of fixed se- 
quential effects. 

Measuring extent of personality factors. To 
quantify the significance of personality factors 
in the TAT protocols, we used a modification 
of Stephenson’s Q-sort technique [9]. The ma- 
terial consisting of the 270 stories from 18 sub- 
jects was given to the judges in two groups of 
135 each. The judges, two well-qualified clini- 
cal psychologists working in different mental 
hygiene clinics, were asked to sort the stories in 
terms of the amount of personality factors re- 
vealed by placing each in one of nine categories, 
with the following normal frequency distribu- 
tion: 

Score 123 @¢ $ 6 FT 8 9 
Frequency 7 11 16 20 27 20 16 11 7 
Stories judged to have little personality mater- 
ial were given a value of 1, stories with a great 
deal of personality material, a value of 9. 


Directions to the two judges were as fol- 
lows: 


You are requested to rate 135 TAT stories on the 
basis of the amount of personality structure and dy- 
namics (motives and motivational structure, atti- 
tudes, defenses, conflicts, self concepts, values, goals, 
etc.) revealed about the subject. 


Please read each story carefully and then place it 
in one of three piles. Place in Pile 1 all those 
stories you believe show few or no personality fac- 
tors. Place in Pile 2 all those stories you believe 
show some personality features (moderately rich 
in personality content). Place in Pile 3 all those 
Stories you believe show considerable or extensive 
personality information. 


Review the stories in Pile 1 (low in personality 


content) and select the 7 stories you believe to have 
the least amount of personality information. Place 
these in Group 1. Review the stories in Pile 3 
(high in personality content) and select the 7 stories 
you believe to have the greatest amount of informa- 
tion. Place these in Group 9. Review the stories 
remaining in Pile 1 and select the 11 stories yon 
believe to have a little more information than those 
placed in Group 1. Place these in Group 2. Re- 
view the stories remaining in Pile 3 and select the 
11 stories you believe to have considerable informa- 
tion but not so extensive as those placed in Group 
9. Place these in Group 8. Review the stories © 
maining in Pile 1 and place the next 16 stories 10 
Group 3. These would be more informative ie 
those you placed in Group 2. Review the Rone 
remaining in Pile 3 and place the next 16 stories i 
Group 7. These should be relatively rich i” co ‘ 
tent but not quite so informative as those place 
in Group 8. First 

Handle the middle group the same way. ar 
place ‘the 20 stories with the least amount of Fife 
sonality information in Group 4. Then place i n 
20 stories with the greatest amount of infima a 
(within this group) in Group 6. The emanis 
27 stories will constitute Group 5. 


Results . 

Differences in amount of fantasy produc 
tions. The first question likely to arise 15* 

there a relationship between length of stort 

and ambiguity level of a card? A word coun 

was made of the 90 stories obtained at ¢4¢ i 
the three levels of ambiguity. The mean ™ 


4 the 
ber of words composing the stories pora 
least ambiguous cards was 980.2, for th? 

Table 1 J 
Differences in Story Length Related 
Test Administrator 
5 F 
3 | a 
a v 
gz ge 3 Eg 
‘6 5 g ww 2 
48 S È REEI a 
$a 2 ote E] p= 
He z5 23 2 
* 
L 1272.9 g 
aa 628.6 188: 
J 644.3 
50* 
L 1272.9 2. 
0.78 
oat 476.7 19 
WwW 796.2 
4.04 
WwW 796.2 7 
46.3 
vs. 151.9 : 
J 644.3 
ent level. 


** Significant at 1 per © 


+ Significant at 5 per cent level: 
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à Table 2 
nalysis of Variance of Values from a Q-Sort of Stories Based on Personality Content 
s ae : 
ource of variation Sum of squares df Mean square F 
Exami 
Bul ease 1036.50 2 518.75 4.76% 
jects in same group 1636.19 15 109.08 
Total between subjects 2672.69 17 
Raters 00 1 00 
Ambiguity level 877.17 2 438.59 
ee X Judges 7.39 2 3.70 
ae X Ambiguity 138.66 Ed 34.67 
Exa iguity X Judges 45.50 2 22.75 
so poe Ambiguity X Judges 62.39 4 15.60 
ed subjects X Ambiguity 2692.20 75 35.90 
Total within subjects 3823.31 90 
6496.00 107 


Total 


et Sion; 
amieane at 1 per cent level. 
gnificant at 5 per cent level. 


ae cards 947.7, and for the most 
Ween tg 785.5. None of the differences be- 
o e means was statistically significant. 
on E research design produced some evidence 
Stories question of whether the length of the 
(persor ai as a function of the behavior 
e recalle reel of the test administrators. It will 
emale e that there were three examiners, on€ 
the stori o males. Word counts were made of 
the reliabi obtained by each examiner. Tests of 
GP aur ility of the differences between pairs 
iners ha indicated that one of the male exam- 
the oth ) obtained reliably longer stories than 
Pre er two examiners. These findings are 
Sented in Table 1. 
prvilferences in content “richness” of fantasy 
Point we The next question, and from the 
is: hon view of this paper, the most important, 
in Ene there differences in personality content 
evel oo as a function of the ambiguity 
ings te the cards? Before presenting the find- 
on; earing on this question, a brief comment 
judge reliability may be helpful. 
jud he „correlation of the scores of the two 
at on is .68, which is statistically significant 
c el per cent level of confidence. While the 
Orrelation does provide a measure of agree- 
ment between the raters, it does not reflect 
accurately the reliability of the pooled ratings 
sed in the analysis. Applying the Spearman- 
rown prophecy formula, the correlation of 


.68, the estimate of the reliability of the com- 
bined judgments becomes .81. 

An analysis of variance was made to deter- 
mine not only the effect of ambiguity level on 
amount of personality material revealed but 
also the effect of examiner and judge differen- 
ces. The results of this analysis are shown in 
Table 2. 

Two factorial effects seem to be significant: 
level of ambiguity of the cards and examiner 
differences. However, neither the judge effects 


Table 3 


Differences in Content Scale Value Related 
to Test Administrator 


g 
# š a 
s a] 2 3 
2 S Eg 
vE g cE 35 
a oO oS xy 
ÈE = S35 as Py 
L 5.82 
G = 1.50 66 2.27* 
L 5.82 
vs. 91 67 1.36 
wW 4.91 
w 4.91 
vs. 59 955 1.07 
J 4.32 


* Significant at 5-per cent level. 
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nor any of the interactions approaches signifi- 
cance. To determine which examiners and 
which sets of cards showed differences a fur- 
ther analysis was made by means of ¢ tests. 
Since the performance of the two judges did 
not show significant differences, their scores 
were pooled. Calculations of ¢ tests are, there- 
fore, in terms of the combined judgments. 
Turning first to the analysis of the examiner 
differences we find that there was no signifi- 
cant difference between the two male examin- 
ers and that one of the male examiners 
obtained stories similar to those obtained by the 
female examiner. The second male examiner’s 
subjects related stories containing higher per- 
sonality values than those of the female exam- 
iner. These findings are summarized in Table 
3 
Finally, examination of the personality-score 
differences as related to picture ambiguity, giv- 
en in Table 4, shows that the cards in the 
medium ambiguous set were significantly high- 
er than those in the least and most ambiguous 
sets. There is no statistical difference between 
the mean values of the least and of the most 
ambiguous groups of pictures. 


Table 4 


Differences in Content Scale Values Related 
to Ambiguity Level of TAT Cards 


v c 

fa T v To 

& 3 a 55 

Bs FEE a5 €g 

ERS Ss ee ty & 

qe a> 23 as ~ 
Least 4.57 

vs. 1.24 54 2.30* 
Medium 5.81 
Least 4.57 

vs. 05 49 -10 
Most 4.62 
Medium 5.81 

vs. 1.19 39 3.05** 
Most 4.62 


** Significant at the 1 per cent level. 
* Significant at the 5 per cent level. 


Our material yielded one other interesting bit 
of information. It will be recalled that Murray 
[9] in constructing the TAT divided the cards 
into two sets of ten. Cards numbered 10 and 
below were believed to be move structured than 


Douglas T. Kenny and Sidney W. Bijou 


those numbered 11 and above. Of the 15 cards 
used in this study, 7 are from the first set of 10, 
and 8 are from the second set of 10. To deter- 
mine whether there was any difference a 
Murray’s estimate of ambiguity and gnent 
personality factors revealed, the data were E 
ranged so that a mean pooled rater judgm a 
was obtained for the 7 cards belonging te t 

first set of 10 and, similarly, a mean eel 
rater judgment for the 8 cards belonging to eS 
second set of 10. The mean “personality T° 

ness value” for the cards from the first se 
cards was 5.22 and that for the cards 1 i 

second 10 cards was 4.82. The ¢ value aa 
.93, which was not statistically sig”! ating 
Hence, when the cards are arranged are his 
to Murray’s classification, we do not an iat 
most ambiguous cards eliciting more sign! an 
personality factors than his least ambigu p 
cards. The possibility that the second series | 


i et : ateria 
pictures often elicits more meaningful ee 
primar! y 

an 


of pictures. 


Discussion 
gs not 


in 
ity an 


This study presents interesting find ; 
. 1 
only on the problem of stimulus ambigt 


: gamine" 
fantasy productions but also on exa™ of the 


havior and fantasy productions. 

male examiners obtained protocols t ‘two eX- 
longer than those secured by the eA ex- 
aminers. The stories given to the p co! 
aminer were also richer in person? st 
tent than those told to the female aoe s be- 
is apparent that interpersonal stim" ifferent! 
tween examiner and subject ha dize the 
effects despite efforts to standar veeainess" 
structions and the conduct of the €% ed tO 


air 
. e regu 
For example, the examiners we" making 


frain from 


read the test instructions, Te the tests, ee 

spontaneous comments during Hea Pieta- 

conversation before and after t on the 

tion of the tests, record the stories “a 

phone, and the like. _ rave ak su ique 
Clinical psychologists ^a + octive tec + the 

that what is obtained from pro) A 


1 
sona o ators 
. sti Ze 
1 invé amely» 


n 


. er: 
is in part a function of the it, 
administrator. Recently EA 
have demonstrated this 
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oe [1], Gibby, eż al. [5], and Lord 
aad Millen Toe the Rorschach technique, 
Hon Test a ‘| with the Thematic Appercep- 
obvious “Sey a from such studies is 
io a idies in this area need to be designed 
from this orm least to evaluate influences 
simple ee Unfortunately this is not a 
could be so Pg ee that such stimuli 
Spots” not only zo the oe re b pine 
investigators. aii s but also to the 
eo Anding on stimulus ambiguity and ex- 
tasy ee ity information revealed in fan- 
consistent ses when taken at face value is not 
terms are Ta the hypothesis that the two 
Foitiose fe op in a monotonic fashion. The 
were no ech iguous cards produced stories that 
rom the rd in personality content than those 
cards with i pe ambiguous cards. Moreover, 
Stories with megan ambiguous values, yielded 
those of the eee personality information than 
that this fi her two sets. It might be argued 
ence ilat ing should not be taken as evi- 
cause of e the monotonic hypothesis be- 
measured T way the terms were defined and 
ments, Fir o this position we offer two com- 
relationship is is axiomatic that any obtained 
teasuremen is a function of the methods of 
cither one nts involved. If we had measured 
might hay or both of our terms differently, we 
hee € obtained different results. 
is the aca point relating to this argument 
efinitio that the hypothesis does not include 
Rach in ns of terms, operational or otherwise. 
the ter vestigator Is therefore forced to define 
ment, Wh Bt accordance with his own judg- 
the a ag being evaluated here, eae is 
scribed, esis with concepts measured as Ce 
rere us now turn to a consideration of the 
ity eae on stimulus ambiguity and personal- 
es gpa Our approach is in terms g cirie 
regard and stimulus generalization [4]. In 
to drive strength, we may infer that the 
i college students serving as subjects (a) 
to Pp nic needa drive level as ae 
veal isturbed or deprived group; and (b) re- 
aled the dominant drive as varying over a 
ide range. For example, the dominant drive 
za one individual may have been achievement, 
ant another, sex, for still another, aggression, 
so on. If this were so, we can then assume 
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that the tendencies for perceptual responses in- 
stigated by the drives of the group were not 

very strong and were heterogeneous in kind. 
Now let us consider the stimulus properties 
of the 15 cards. We could assume that the card 
stimuli varied in at least two dimensions: (a) 
the number of cue-constellations available for 
selective reactions, and (b) the general defi- 
niteness level of the cue-constellations. Accord- 
ing to this formulation cards in set A would 
have a low frequency of cue-constellations. In 
addition most of these cue-patterns would be 
sufficiently definite to evoke similar perceptual 
responses from members of the group. On the 
other hand, the most ambiguous cards, set G 
would have a high frequency of cue-constel- 
f them would vary in defi- 
patterns that yield a high 
degree of perceptual response agreement. The 
of course, have intermed- 


cards in set B would, 
iate stimulus properties between those in set A 


and set C. i 
According to this formulation, cues in set A 


should produce response tendencies which com- 
pete favorably with those from the dominant 
drives. These stories should be “card domina- 
d consist of the symbolizing 


ted.” They shoul i 
(and other) processes associated with the inter- 


preted meanings of the cards. The hypothesis 
of how the story evolves is somewhat like this: 
In compliance with test instructions the indi- 
vidual selects and makes a perceptual reaction 
to an aspect of the card. He then relates organ- 
ized verbal material pertinent to the need-satis- 
faction sequences, the conflicts, frustrations, 
gratifications, and so on. Stories based primar- 
ily on card stimuli would not be expected to 
contain much about the individual’s dominant 
drive and the related personality concepts. By 
the same token, cards in set B should evoke 
perceptual response tendencies about equal in 
strength to those from the drives. In these situ- 
ations sometimes the picture stimuli dominate, 
at other times the drive stimuli govern. In any 
case, many “perceptual errors” could be made. 
Numerous stories would therefore be based on 
the dominant drives. Such protocols should 
yield more information about personality than 
those from the pictures in set A. This is in 
agreement with the findings. Finally the cues 
in the pictures of set C should elicit weak re- 
sponse tendencies which would easily be over- 


lations and most 0 
niteness from Cue- 
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ridden by response tendencies of the major 
drives. Stories from this set of pictures should 
be “drive dominated” and should reveal most 
about personality factors. This expectation is 
not in agreement with the findings. 
What are some of the ways of accounting for 
the discrepancy between hypothesis and fact? 
(a) The hypothesis needs to be modified to ac- 
count for another variable. It is possible, for 
example, that an uncontrolled influence was 
operating to lower fantasy behavior in response 
to cards in set C, which were the most ambig- 
uous pictures. Some investigators [3] have sug- 
gested that as situations become increasingly 
vague, anxiety or stress is increased. Such a sit- 
uational condition may have a general inhibi- 
tory effect on the performance to the least 
structured cards. (b) The cue-patterns in the 
cards do not vary as assumed—increasing am- 
biguity is correlated with an increasing number 
of cue-patterns and a decreasing clarity of cue- 
patterns. It is conceivable that there was a low 
relationship between either one or both of these 
dimensions and the judges’ estimates of number 
of possible interpretations [2]. (c) The cue- 
patterns do vary as assumed, but there were 
qualitative differences among them. For in- 
stance, cards in set C may have had a greater 
number of cue-patterns than those in set B, but 
the latter had more relating to drives and situ- 
ations of an interpersonal nature. In line with 
this comment, it should be pointed out that 
there were more human figures in set B than 
in set C. (d) Finally, the judges, in accordance 
with their training and experience as clinical 
psychologists, were inclined to give greater 
weight to protocol contents having to do with 
drives and dynamics associated with behavior 
pathology such as sex and aggression, and to 
underevaluate those pertaining to the milder 
and more “normal” processes such as affiliation 
and achievement. Presumably material concern- 
ing either set of terms would be revealing 
about personality, but because of the judges’ 
orientation the pathological could have rated 
higher than the normal. Such a bias could have 
had a differential effect considering the con- 
tent of the cards from set to set. 


Summary 


This paper describes an experiment testing 
the assumption of a direct re‘ationship between 


Dotglas T. Kenny and Sidney W. Bijou 


stimulus ambiguity and extent of personality 
factors revealed in evoked fantasy. On the basis 
of findings in an earlier study, three sets 2 
TAT cards varying in degree of ambigu 
were selected and given to 18 young adult a i 
subjects. Two well-qualified clinical prhe e 
gists, utilizing a Q-sort technique, judged t 
significance of the personality factors injecte 
into the fantasy stories. i f 

The results from an analysis of variance Ke 
the Q-sort scores are not consistent with : 
hypothesis under investigation. With increasing 
stimulus ambiguity there is an initial ay 
in the extent of personality factors reveale m 
the fantasy, and then a decrease. In addie er 
it was shown that the behavior of the ae 
plays a role in fantasy productions. It kimea 
cards from Murray’s second series 
veal more information about person 1 
cards from his first series. 

The hypothesis and the finding 
lyzed in terms of drive strength an 
generalization. 


ç are ana 
q stimulus 
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Measuring Achievement Motivation with 
“Picture Interpretations” 


Henry H. Morgan 


Psychologic 


is Fs mati: of achievement motivation 
Teported le NI recent research which has been 
J. This z McClelland and others [2, 3, 4, 
the a employed a short version of 
hh ae enna Ter (TAT) in 
Slides a Wwaikten in response to picture 
Achieveme scored for Murray’s need for 
dhe Rana ar n Aeh [7, pp. 144, 164]; Tn 
groups af aani by McClelland et al. [4], 
mentally Sir jects took the test under experi- 
Scoring syste nend niativätidnal states, and a 
ifferences was evolved which made use of 
under ‘ee ound between those taking the test 
taking j go-involving conditions and those 
Th it under “neutral” conditions. 
erowth pig about to be described is an out- 
Part of a T research mentioned above and is 
undertaker ffice of Naval Research project 
achievem n to develop a standardization test of 
study a motivation.” One purpose of the 
tween as to determine the relationship be- 
n Ach eo for achievement motivation, or 
k s and a criterion of achievement which, in 
Was ase, was school grades. Another purpose 
S to test the stability of Ach scores over @ 
Period of time. 


Procedure 


In wii sample. The subjects tested were boys 
En ‘a Junior class of high schools in a New 
en and industrial city. Five groups of boys 
subje used, ranging in number from 39 to 62 
ac; ar Groups 1, 2, and 3 were from a large 
si emic high school, while Groups 4 and 5 
(S ere from a vocational high school where shop 
Ourses contributed to the grade criterion- 


2-116, Contract No. N 


Resear: j NR 17 re o 
ch P; i 
OJEE under the direction of 


onr 559(03) 
1951-52, was s 

= C. McClelland, Wesleyan University. Contract 
rsonnel included R. A. Clark, H. H. Morgan, R. 


- Freeman, and R. W. Lull. 


al Corporation 


Students had taken the Otis Quick-Scoring 
Mental Ability Test (Beta test, Form Cm) 
during their freshman year in high school, and 
Otis 1Q’s were available for a majority of the 
academic high school group had 
s IQ of 109, while each voca- 
had an average IQ of 


subjects. Each 
an average Oti 
tional high school group 
99 on the Otis. 


The measuring instrument. The achievement 


motivation test under development has been 
designated “Picture Interpretations,” or P-I, 
to distinguish it from Murray’s TAT. From 
a pool of pictures, some of which had been pre- 
tested in other high school populations,? four 
forms of P-I were constructed. These forms, 
incorporating 36 different pictures, were desig- 
nated E, F, G, and H. Forms E, F, and G, 
which were made up of 12 pictures each, used 
plain unstructured response sheets (814 in. X 
14 in.) for the recording of the stories by the 
subjects. Form H, which contained the first 
eight pictures of Form G, had the same over-all 
time limit of 30 minutes for the test but used 
slightly different response sheets on which were 
printed a series of “story structuring” questions 
d in previous 7 Ach studies [4]. In all 
bjects viewed each slide projection 
for a period of ten seconds. In the administra- 
tion of Forms E, F, and G two and one-half 
minutes were allowed after each slide presenta- 
tion for story writing, but in the administration 
of Form H three and three-quarters minutes 
were allowed for the writing of each story. 
Subjects were told that the testing program 
was sponsored by the Office of Naval Re- 
search, that the test results would be used for 


use! 
groups, su 


2Forms A, B, C, and D of P-I yielded correlations 
of n Ach scores and grades that ranged from .22 
to .38. With intelligence partialed out, corcelations 
of n Ach scores and grades ranged from .13 to .38 
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research purposes only, and that students’ re- 
sponses would be kept anonymous. Each re- 
sponse booklet ‘contained mimeographed in- 
structions for the test, and these instructions 
were read aloud to the subjects before each test 
administration. The instructions for Forms E, 
F, and G are given below. Those for Form 
H were slightly different owing to the altered 
time limits. 


Instructions 

You are going to see a series of pictures, and your 
task is to tell a story that is suggested to you by 
each picture. Try to imagine what is going on in 

each picture. Then tell what the situation is, what 
led up to the situation, what the people are think- 
ing and feeling, and what they will do. 

In other words, write as complete a story as you 
can—a story with a plot and characters. 

You will have ten seconds to look at a picture 
and then two and one-half minutes to write your 
story about it. Write your first impressions and 
work rapidly. I will keep time and tell you when 
it is time to finish your story and to get ready for 
the next picture. 

There are no right or wrong stories or kinds of 
stories, so you may feel free to write whatever story 
is suggested to you when you look at a picture. 
Spelling, punctuation, and grammar are not im- 
portant. What is important is to write out as fully 
and as quickly as possible the story that comes into 
your mind as you imagine what is going on in each 
picture. 

Notice that there is a half page for writing each 
story and that a picture number appears on each 
half page. If you need more space for writing any 
story, use the reverse side of the paper. 


In the administration of all forms a warn- 
ing, “Try to finish your story in 30 seconds,” 
was given one-half minute before expiration of 
the allotted writing time. 

Data collection and analysis. Forms E, F, 
and G of P-I were administered to Groups 1, 
2, and 3, respectively, in March, 1952, and 
each group was given either Form F or Form 
E as an alternate form five weeks later in 
April. Groups 4 and 5 were tested with Forms 
G and H, respectively, in F ebruary, 1952. 

The protocols were analyzed for n Ach by 
two scorers using P-I scoring system “D”,® a 
modification vf system “C” [4]. A reliability 
coefficient of .89 was obtained for a sample of 

McClelland, D. C., Clark, R. A., and Morgan, 

H., Revisions in the system of scoring imagina- 


tive stories for need: Achievement (z Ach) ; scoring 
system D (April, 1952). Unpublished paper. 


4 
protocols analyzed by each of the scorers. 
Results 


Product moment correlation coefficients a 
tween n Ach scores, grade averages, and inte 
gence test scores are given in Tables 1 por 
5. Tables 1, 2, and 3 present the results for 
academic high school groups, while the send 
for the vocational high school groups are eM 
in Tables 4 and 5. : 

Correlations in Tables 1 through 5 which 
are .39 or greater are significant beyond the 5 
level of confidence using a CR technique ifi- 
p. 122]. Correlations of .29 to .36 are SEE 
cant beyond the .05 level. Correlations en 
-27 or lower do not reach the .05 level © 


l t ; h are 
fidence. The partial correlations, Kei with 
between Ach scores and school grades Y ej- 


Otis IQ partialed out [5, p. 141], give ony 
mate of the relationship between n Ach re con- 
achievement criterion if intelligence is hel rto 
stant. The subscripts of the partial r’s re ae 
the variables listed in the correspondingly 4 
bered columns or rows in any given tab aaa 
Examination of Tables 1 through 3 "° hips 


a ns 
that, in general, low to moderate relatio 


Table 1 n Ach 
Correlations between IQ, School Grades, me Hig 


. . emi! 
Scores among Junior Boys in an Acade ) 


P 
N 
P 
an 
> 


1. Otis IQ 


2. Sophomore 
Grade Average .42 


3. Junior Grade 25 
Average 45 81 Ga 
4. n Ach 
(Form E) -03 
5. n Ach 29 56 
(Form F) .09 19 S 
rtial Correlations: 742.1 
s = 17; Tega = 2S scored W 


aN 

a 
cs 
© 


is) 
Ra 


56 


s 
the author, those for Cai A 
Freeman. Interscorer T 3 
as -89- 

from Group 3, Form G, W 
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Correlati Se 
2 ations between IQ, School Grades, and n Ach 
res among Junior Boys in an Academic High 
School, Sample No. 2 (N = 39 to 53) 


(Form E administered 5 weeks after Form F) 


1 2 3 5 

A 
8 T a 
r e 2 2 & a 
Variable A o? seg -g Pe: 
z #95 298 8 35 
° nod KO ps) ee 


—_ SSK Boe TEE 


1. Otis 1Q 


és a 56 -24 . 
2. Sophomore i 
Grade Average 16 = -65 igs #2 
3. a Grade 
verage +56 65 
4.2 Ach = 7 ” 7 
(Form F) 
2400 AS AT n 56 
5. n Ach : 
eee E) .73 43 29 56 = 
artial Correlations: r, = 
TETT = 42; 
Torr = 46; T53.1 = 22. iia ' 
Table 3 


Cor, i 
ia between IQ, School Grades, and n Ach 
among Junior Boys in an Academic High 


School, Sample No. 3 (N = 51 to 61) 
Fi z ini 
aeo ee ie eS 
abe 
1 2 3 4 ? 
2 T a 
6 v © 
Variable S BoF See g 
Ò aod RO4 sŠ eh 
a i 
Otis 1Q me 35 50 22 13 
* Sophomore 
š rade Average .35 = -70 Al ee 
* Junior Grade 
Average 50 70 ie 39 at 
ton Ach 
. (Form G) 22 41 39 =- 64 
"2 Ach 
Lom E) a3 28 24A _ 64 = 
matal Correlations: r421 = 36; Tasa a 
taa 5255 Pga m2 


ae between n Ach scores and grades. There 
€ also low, moderate, and high relationships 

Ms tween n Ach scores and intelligence test 
Ores as well as substantial relationships be- 
een intelligence test scores and school grades. 
ith intelligence partialed out, relationships 

So: n Ach scores and school grades tend to be 
mewhat reduced. 


= 
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Table 4 R 
Correlations between IQ, School Grades, and n Ach 
Scores among Junior Boys in a Vocational High 
School, Sample No. 4 (N = 45 to 50) 


1 2 3 4 
2 a 
e E & , & fal 
š = Sos Bo 
Variable 2 =: 5 #3 E 3 E 
ro) aod Sos Ë 
1. Otis IQ a.. 27 32 26 


2. Sophomore 


Grade Average .27 iss -70 04 
3. Junior Grade 

Average 32 70 oe a5 
4. n Ach 

(Form G) .26 .04 15 es 


Partial Correlations: r493 = —03; 743.4 = -07. 


Table 5 
Correlations between IQ, School Grades, and 2 Ach 
nior Boys in a Vocational High 


Scores among Ju 
(N = 40 to 48) 


School, Sample No. 5 


1 
g o 
2 p 2 i} 
o E ù č 
F ri gee 886 sE 
Variable 2 ag $ | ze 688 
fo) nud BUS ett 


1. Otis IQ 
2. Sophomore 


Grade Average .55 .67 ai 
3. Junior Grade 

Average 46 67 aie 27 
4. n Ach 

(Form H) 36 3i .27 the 

Partial Correlations: r421 = 145 ras. = 09. 


Tables 1, 2, and 3 give the correlations be- 
tween alternate forms of P-I administered five 
weeks apart. These correlations of .56, .56, and 
64 indicate that n Æch scores are fairly stable 
over a short period of time. 


Discussion 


The correlations between n Ach scores and 
grades vary from one group to another, and 
these variations may be due to several causes. 
In the first place, sample sizes are limited, 
ranging from 39 to 61 subjects, and therefore 
random fluctuations of considerable size may 
be expected among the coefficients computed in 
the various groups or samples. Some fluctua- 
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tions fall well within SEr wnich, in most 
cases, approximates .14. In addition to unrelia- 
bility due to the limited size of the samples, a 
certain amount of unreliability is probably in- 
herent in the grade criterion, whose reliability 
can be estimated by the correlations between 
sophomore and junior grades which range from 
-65 to .81. Furthermore, the reliability coeffi- 
cients of .56, .56, and 64 based on alternate 
forms of the achievement motivation test show 
that the P-I technique itself is another source 
of unreliability. One more factor accounting 
for some of the variation in correlations from 
one sample to another may be the differential 
effectiveness of the various test forms used in 
measuring n Ach.5 


In this study, the n Ach scores derived from 
alternate P-I forms appear, for projective tests, 
to be moderately reliable. However, the rela- 
tionships of n Ach scores to grades and to in- 
telligence appear less stable, and predictions on 
the basis of individual n Ach scores may not be 
made with confidence at the present stage of 
test development. Since achievement motiva- 
tion, as measured by n Ach score, might be ex- 
pected to vary somewhat from one time to 
another in the same individual, future P-T test 
reliabilities may not rise very much above those 
reported in this study.® These reliabilities dem- 
onstrate that n Ach score may be considered a 
measurement of an enduring personality trait 
just as the initial experimental studies of Mc- 
Clelland et al. [4] showed that n Ach score 
reflects temporarily induced motivational states. 

A number of writers [1, 8] believe that, in 
work with projective techniques, standard test- 
retest or split-half reliabilities are of less impor- 
tance than interscorer reliabilities which test 
the stability of interpretation from one investi- 
gator to another. The interscorer reliability of 
-89 reported in this study, as well as higher fig- 
ures reported by McClelland [4], show that 


°Further analysis of the data has been undertaken 
by Dr. Henry N. Ricciuti, Educational Testing Serv- 
ice, to determine which pictures and which com- 
ponents of the # Ach scoring system are contribu- 
ting consisten‘ly to the relationship between 2 Ach 
Scores and achievement criteria. 

®Split-half reliability coefficients (Spearman- 
Brown) on Forms A, B, C, and D ranged from .36 
to .77, 


Morgan 


the z Ach scoring system 1s a highly consistent 
one. 

The results of this study and other P-I stud- 
ies show that the test, which began as a projec- 
tive technique for the experimental study of 
motivation, holds some promise as a predictive 
instrument for forecasting achievement. 


Summary 


A story-telling test known as Picture Inter- 
pretations, or P-I, was administered to five 
groups of junior boys in academic and voca- 
tional high schools. Stories written in response 
to a series of pictures were scored for achieve- 
ment motivation or need for Achievement 
(n Ach). Fl 

Low to moderate relationships were foun 
between » Ach scores and school grades w 
also between n Ach scores and intelligence 
The relationship between n Ach scores an 
school grades tended to be somewhat less when 
intelligence was held constant by use oF OF 
Partial correlation technique. ks 

Alternate forms of P-I given five wee 
apart yielded reliability coefficients of 56, « ly 
and .64 indicating n Ach scores to be fait 
stable over brief periods of time. 
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Social and General Intell 


igence and Performance on 


the Rosenzweig Picture-Frustration Study 


Lawrence Karlin 
New York University 


and Milton 


Rutgers 


Inspecti 
picted by ehe wee various social situations de- 
(EF) test = osenzweig Picture-Frustration 
Intelligence ig the possibility that social 
Such as snotivation, from other determinants 
In determining lent nice, iets Say blay amie 
to these ten € type of response that is made 
Study is to ex i The purpose of the present 
the pattern a ore this possibility by analyzing 
tween the scori interrelationships obtained be- 
>F test and pr categories of the Rosenzweig 
cial intelligen le subtests of a well-known so- 
ashington T, test, in this case the George 
Bence Test, niversity Series Social Intelli- 


To some ex 


ious tent at least, responses to the var- 


rtin de on the P-F test might require a 
Sight and gre of inventiveness and social in- 
Telationshj a one might expect a positive 
Ses indicati, been the occurrence of respon- 
test and th ng these characteristics on the P-F 
Same cha € subtest purportedly measuring the 
test, p acteristics on the Social Intelligence 
diffieup ee emotes indications of behavioral 
Telate with aes on the P-F test might cor- 
the octal ack of social skills as measured by 

al Intelligence test. Thus, the compar- 


Son of 
€ach i Pattern of performance obtained on 
ght enhance the understanding of the 


Project: 
hee material furnished by the P-F test. 
Cideq Complement this comparison it was de- 
Ntellige, ave a conventional test of general 
of Monet’ the Otis Self-Administering Tests 
Plorato al Ability. It was felt in such an ex- 
Centeri Ty study that the general hypothesis 

ich Ng around the influence of social skills 
Ness ae make use of a person’s inventive- 
insight would also be reflected in sig- 


M. Schwartz 


University 


nificant relationship with a test of general in- 
telligence. 
Subjects and Materials 


The three tests were administered to 45 male 
students in introductory psychology classes at 
Rutgers University at two-week intervals in 
the following order: Otis Test of Mental 
Ability, Rosenzweig P-F test, and the Social 
Intelligence test. The following isa brief de- 
scription of the tests employed: 


Rosenzweig Picture-Frustration Study (Re- 
vised Form) [3]. This is a semiprojective person- 
ality test consisting of 24 picture situations portray- 
ing in cartoon-like fashion typically encountered 
“frustrating” experiences. In each picture there is 
depicted conversation between the person producing 
the frustration and the one presumably being 
frustrated. The subject is required to write, in the 
space provided, his first response to the frustrating 
statement expressed. Scoring is in terms of the 
standard procedure of Rosenzweig which consists 
of seven scoring categories; three involve Direction 
of Aggression (Outward, Inward, and Nonaggres- 
sion) and four Types of Reaction, (Obstacle-domi- 
nance, Ego-defense, Need-persistence, and Denial). 
2. The George Washington University Series 
Social Intelligence Test of Moss, et al. [1]. This 
test consists of five subtests, namely, Judgment in 
Social Situations, Recognition of the Mental State 
of the Speaker, Memory for Names and Faces, Ob- 
servation of Human Behavior, Sense of Humor. 
Each test may be scored separately and the scores 
may be combined into a total score which repre- 
sents the sum of the subtests. These will be de- 
scribed under results wherever necessary to eluci- 
date the meaning of the findings of this study. 
Suffice it to say at this point that the literal mean- 
ings of each of the five titles provides a good idea 
of the content of each. ği 
3. The Otis Self-Administering Tests of Mental 
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j Table 1 
Chi Squares for the P-F, Social, and Otis Tests 
P-F Test Categories Otis test 
E g 
= 2 
Variable df B A 3 PE 3 i § q 
5 £ B aq a ve Fi 
A G E 33 & i A 
Social intelligence 
Judgment in social 
situations 1 47 —.08 2.00 16 16 -2.33 -04 wa 
Recognition of mental 
state of speaker 2 -11,30*** 4.357 JAGS 2.02 —.94 76 -.67 ou 
Memory for i 
names, faces 2 -3.38 6.59%% 20 -1.80 -29 -1.23 20.30%" 2 
Observation of 
human behavior 1 63 -1.40 -41 .00 -29 111 -41 o 
Sense of humor 2 40 -1.54 17 09 iie 1.65 09 30 
Total 1 -.99 23 122 .08 -.15 .00 -.09 i 
Otis test 1 36 36 -.36 11.00*** -.36 22,60"** = -.70 
Note—Negati: ign indicates that i ip is i 
* Significant a ai at ey the trend of the relationship is inverse. 
** Significant between .01 and .05 level, 
*** Significant beyond .01 level. 
a z f 
Ability, Higher Examination, Form D [2]. This : mple 0 
. s tha c a random $4 
well-known test consists of 75 heterogeneous items vi i be expected in a rand 
relating to such aspects of general intelligence as sneer sauates: . lies in the 
measured by number series, analogies, reasoning, etc. The salient feature of this table ee o the 
The shorter 20-minute time limit was used with fact that the major scoring categories e, Im 
this test. P-F test (Extrapunitive, Iritropuñ ant chi 
punitive) yield two highly sign! re with 
a 


Results and Discussion 


The major results are summarized in Table 
1 which shows the interrelationships among the 
scoring categories of the Rosenzweig P-F test, 
the subtests of the Social Intelligence test, and 
the Otis Intelligence test. The entries on this 
table are chi squares determined from contin- 
gency tables in which the scoring categories of 
the P-F test were divided into two categories 
by median split while some of the subtest scores 
of the Social Intelligence test were divided by 
median split and others into high, middle, and 
low categories. The latter type of division was 
necessary because in some of these subtests too 
many scores were concentrated at the median. 
Thus some ot the responses are based on 2 X 2 
and some on 3 X 2 contingency tables. 

Inspection of these tables discloses that most 
of the values are not significant. However, 
there are more highly significant chi squares 


squares and one near-significant chi $4 fental 


the subtest entitled Recognition of the cial 
State of the Speaker (RMSS) 07 He ation 


Intelligence test. To evaluate these 
ships let us first describe briefly the 


5 s um 
tion has to be selected. One item, N 

is as follows: lip Í 
at opportunity © nged 
‘things ad 10 


8 


“If only I had not let th 
might now be enjoying the 
for.” 

(A) Despair (B) DisapP' 
liness (D) Regret 


A comparison of this type 
items in the P-F test suggests 
in that the P-F test item ier = sen 
which provides information tha 


©) Lone 


ointment 
«4, the 

of item with p 

a basic si 


seuat: 
situ 
sents 2 Sie used 


a 


Social and General Intelligence and the P-F Test 


spestritterize the mental state of one of the 
a Skaon § example, in Item 2 there is shown 
Scattered o; S which fragments of a vase lay 
is seen moi the floor near a table and a woman 
hat was S to another woman “How awful! 
viele a mother’s favorite vase you broke.” 
the other a testee provides the response for 
as made te ‘ie 5 It is clear that the statement 
Drovides a teach foe depicted by the cartoon 
of the Speake T for assessing the mental state 
of item ee heya be noted that this type 
Mental atte oF th tha Safemension. about the 
verbal and Pe ee speaker on the basis of both 
verbal material aro material as against only the 
Bence test, provided by the Social Intelli- 
Piel pau with which we are specifically 
the mental ey enter the ability to recognize 
the Social ine the speaker as measured by 
Volved in the _ igence test is importantly in- 
type of item Tee or made to the P-F test 
and near-signifi ng aforementioned significant 
the main comm icant chi-square values between 
this subtest pile. categories of the P-F test and 
Westion, Thee an affirmative answer to this 
ed by the Sack Conclusion is further document- 
Tationale ‘cn that a fairly clear and specific 
hus, i. Bes found for these relationships. 
a chi-square y ee (E) category yields 
01 level, In a oe at better than the 
1n the Sean hi ition, the relationship is inverse 
With a low hon a high Æ score tends to go 
Tesult seem ISS score. The meaning of this 
igh-¥ a to be fairly straightforward. The 
gressive ividual is typically very outwardly 
B in age and tends not to modify his respon- 
id, i ordan with the needs of others. I 
expression vend necessarily limit the outward 
tioned at se his aggression. It should be cau- 
at this point that there are other dimen- 
2 eg. O-D, etc.) in the description of 
the needy Person. We have here emphasized 
the pur Important and pertinent dimension for 
i Pose of this comparison. . 
d ig le most significant chi square = 
cial Į etween the RMSS category =. e 
Punitive eee azence test and the P-F ea a 
dividu pa scoring category. The hig zi 
Teactio at tends to be fairly objective in Ms 
in an NS to situations in that he does not react 
nwa ane manner either outwardly or 
rdly; he does not, in general, place blame 


taine 
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for the difficulty and tries to minimize the 
frustrating features of the situation. This type 
of behavior may be due to a lack of concern for 
the situation (in extreme cases, a type of schi- 
zoid reaction), or it may be due to a desire to 
protect the feelings of all involved. It is this 
last characteristic, we feel, that provides the 
basis for the positive relationship between the 
RMSS category and this one on the assumption 
that the desire to protect the feelings of others 
arises from an increased awareness of and sen- 
sitivity to their mental states. 

Finally, the Intropunitive (J) category of 
the P-F test displays a tendency to vary posi- 
tively with the RMSS score. Chi square is 
e between the .05 and .10 levels 
so that by conventional statistical standards the 
validity of this relationship is more speculative 


re the other two. However, it is not 


than we 
difficult to find a rationale for this positive 


association. The high-Z person is often one who 
tends first to blame himself when involved 
with frustrating problems. We may hypothe- 
size that a basis for this self-blame lies partly 
in a developed appreciation and exaggerated 
sensitivity to other people’s reactions. 

The other Social Intelligence test scoring 
category to show significant relationship to the 
P-F test is Memory for Names and Faces 
(MNF). At the outset of the test the subjects 
are required to study for four minutes the 
photographs of the faces of twelve college-age 
males with a name below each face. Midway 
in the test the subjects are shown twenty-five 
faces among which are distributed the twelve 
originally examined. For each of the twelve 
names four of the twenty-five faces are suggest- 
ed from which the subject must choose the cor- 
rect face associated with the given name. MNF 
is significantly related to the Intropunitive (J) 
and Denial (D) scoring categories of the P-F 
test. 

Examination of the two types of “items” 
subsumed under the categories of the respective 
tests reveals no palpable resemblances. In fact 
the facial characteristics of the cartoon figures 
in the P-F test are deliberately left unstruc- 
tured to enhance its projective features (sex 
and age, however, are discernible). 

Thus, unlike the comparisons discussed 
above, the form and content of these two types 
of items do not provide a ready rationale for 


significant her 
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explaining the high positive association indica- 
ted by the very significant chi squares obtained. 
On the basis òf the conventional descriptions 
as well as our own experience, a rather specu- 
lative hypothesis to account for this association 
is offered. Specifically the Denial (D) cate- 
gory is symptomatic of generalized ego-insecur- 
ity. In fact, the high D is specifically suggestive 
of this characteristic. Our experience with 
people who are predominantly characterized by 
ego-insecurity suggests that these tend to be 
alerted to the facial expressions of others to a 
high degree. The reason for this is primarily 
due to their need for a continual assessment of 
their position in a social situation and this they 
must do by observing the behavior of others. 
The D-type person, being very anxious, tends 
to rehearse the events of previous situations in- 
cluding the observed behavior of people in these 
situations. This is a symptom which often goes 
with marked anxiety such as is created by inse- 
curity. It is hypothesized, therefore, that the 
excessive attention to and rehearsal of others 
may have developed his ability to recognize 
faces. Thus, in the MNF situation at least a 
part of the task, that is, recognizing a face, is 
facilitated. Admittedly the empirical links be- 
tween this hypothesis and performance on the 
two types of items are rather indirect. Still, it 
would not be impossible to test this hypothesis 
by correlating the MNF subtest with some 
other measure of feelings of inadequacy. 


It may be noted also that the Intropunitive 
(I) category shows significant relationship 
with MNF (<.05). The writer can offer no 
basis for this other than to suggest the possibil- 
ity that the J and D categories may be correl- 
ated. 

Turning now to the interrelationships be- 
tween the Otis Test of Mental Ability and 
the P-F test, we find two striking results, 
namely, highly significant chi squares for the 
Obstacle-Dominance (O-D) and Need-Persis- 
tence (N-P) categories. High score in the O- 
D category indicates, other things equal, an 


2. Otis, A. S. Otis self-administer! 


3. Rosenzweig, S. The picture- 
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individual who emphasizes the frustrating 
character of the situation, that is, the particular 
circumstance which is at the root of the frus- 
tration. Thus, he is highly task-oriented. It 
may be that the significant chi square 1n = 
instance indicates that the more intelligent a 4 
ject tends habitually to emphasize the prob at 
aspect of the situation rather than the persona 
ities involved in the situation. In short, 1t may 
be that the more intelligent individual, because 
of his greater success with problems, exhibits $ 
tendency to be task-oriented rather than ego 
oriented. A similar rationale may be employer 
in the case of the N-P category. In fact, ni 
even greater extent this type of individua e 
concerned with solving the problem 1nv0 y 
in the P-F test. 


Summary and Conclusion 


The present study compared performance o 
three tests, the Rosenzweig P-F, eS ec 
Washington University Social Intellige ose 
and the Otis Mental Ability tests. The ae 
of this comparison was, in part, to den e 
the relationship between the influence © sje 
abilities as are measured in the two types > test: 
telligence tests on performance in the pI und 
The significant relationships which were Pie 
suggest the possibility that certain & pon eon 
the P-F test. This finding also sU 
general hypothesis that differences 1" a 
the P-F test situations are perceived pa” 


dition responses made to the test. 
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The Practical Utility 
Charles 


of the Clinical Report 
A. Dailey 


Veterans Administration + 


Thi , 
win eee present a technique of meas- 
t is an atten ical utility of a clinical report. 
answering thi G ro aag an. abjechye way of 
or clients be d question, “How should patients 
Port?” described in the psychological re- 

A 1s 
ealt eent empirical study by Davenport [3] 
the relationshi problem from the standpoint of 
data upon a i of the clinical report to the 
Present en ias it is based. In contrast, the 
tionship of Gera = concerned with the rela- 
Process itself, clinical report to the treatment 

Yor i 
utility a of the present discussion, the 
Possible decisi port is defined as relevance to 
tient describ ee about treatment of the pa- 
Utility, one ed in the report. In measuring 
treatment Pree compare the report with the 
in Which A seni employed in the institution 
ince a — is to be used. 
Semantic sme is always made to someone, 
its Drattical rity is also involved in appraising 
ity for ihe value. It is essential to study clar- 
thing rel reason that it is possible to say some- 
z evant about a patient without saying 


it clearly, 


The Measurement of Utility 


T 
quires present method of measuring utility re- 
j e following steps. 
Which he first obtain a list of the decisions 
Counseling ordinarily made by the particular 
Service, T » neuropsychiatric, or psychological 
ere, we n the exploratory study described 
trists, 4 de te the psychologists, psychia- 
mend social workers of our service to rec- 
their opi decisions about treatment which, in 
e Bi s are frequently made concerning 
ese mee of their service. After refining 
€commendations, we obtained the list 


1p 

To = . 

ferso, m the Veterans Administration Hospital, Jef- 
arracks, Missouri. 


shown in Table 1. It will be noted that this list 
contains a number of decisions which probably 
have no relevance to psychological reports. 
They are nevertheless included for the purpose 
of illustrating the technique. It is also obvious 
that the list is only a crude approximation to 
the decision-making process as it actually oper- 
ates on such a service. 

2. As a second step, the list was submitted to 
a group of ten clinical psychologists familiar 
with this service. Each was asked to “make the 
set of 32 decisions as if you were dealing with 
the average neuropsychiatric patient on this 
service. Indicate your opinion as to the appro- 
priate treatment for this hypothetical average 
patient by stating ‘yes,’ ‘no,’ or ‘don’t know’ in 
response to each question.” The responses of 
these clinicians were compiled and are reported 
in Table 2. This consensus of clinical opinion 
provides a base line from which the new infor- 
mation value of a report may be calculated. 
Such a measure is important to provide a con- 
trol upon stereotypy in decision making; we 
must make certain that, in making decisions 
about a patient after reading a report about 
him, the clinician is not merely repeating a pri- 


ori decisions.” 


3. The thi 


the reports whic 


rd step requires the appraisal of 
h are to be measured for util- 
ity. A clinician who is otherwise unfamiliar 
with the specific patient reads each report and 
then fills out, in checklist form, his recommen- 
dations for each of the decisions about treat- 
ment. His recommendations are then scored as 
to their deviation from the a priori recommen- 
dations (Table 2). A weighting system is em- 
yed for this purpose which attributes to each 


plo i 
f the proportion of clini- 


decision the inverse 0 


2The author is indebted to the work of Cronbach 
[1] and of Kelly and Fiske [5] for emphasis upon 
the concept of relative information value in psy- 


chological appraisal. ` 
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Table 1 


List of Frequently Made Clinical Decisions 


1. 


11. 
12. 
13. 
14. 
15. 
16. 
17. 


18. 
19, 


20. 
21. 


22. 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


Should the patient have been admitted to the 
psychiatric ward? 

Should he be put on closed ward (for reasons 
other than electroconvulsive therapy) ? 

Should he receive electroconvulsive therapy? 
Should he receive subshock insulin? 

Should he receive intensive, interpretive in- 
dividual psychotherapy? 

Should he receive supportive, noninterpretive 
psychotherapy? 

Should he receive group psychotherapy? 
Should he be restricted for the first three days? 
Should he receive repressive individual psycho- 
therapy (i.e., therapy directed toward inhibit- 
ing completely some impulses and ideas) ? 
Should he be allowed visitors now from im- 
mediate family? 

Should he receive sedative drugs? 

Should he receive vitamins? 

Should he be placed on a special diet? 

Should he receive placebo? 

Should he have amytal interviews for cath- 
artic purposes? 

Should he have hypnotic treatment for cath- 
artic purposes? 

Should he have a male therapist? 

Should the therapist play an authoritarian role? 
Should the therapist play a nurturant role 
(i.e kindly and especially tolerant of depend- 
ency needs) ? 

Should the patient have occupational therapy? 
Should this patient discuss his vocational fu- 
ture with the vocational counselor? 

Should the patient work in Manual Arts 
Therapy? 

Should the patient be transferred now to a 
mental hygiene clinic? 


Should his relatives be given therapeutic in- 
terviews? 


Should the patient receive especially solicitous 
attention from ward personnel? 

Should the patient be particularly encouraged 
about his resources for “adequate living,” “suc- 
cess,” etc. ? 


Should the patient be watched for assaultive 
tendencies? 


Should the patient be watched for suicidal 
tendencies? 

Should the patient be encouraged to make his 
own decisions about length of stay? 

Should ti.e patient be encouraged to improve 
his educational status? 

Should the patient be encouraged to change his 
job? 

Should the patient be encouraged to seek the 
aid of Alcoholics Anonyr:.ous? 


Table 2 


Responses of Ten Clinicians to the Question 
of What Treatment Should be Given to the 
Average Neuropsychiatric Patient 


Treatment Number of 
decision clinicians responding | 
number Yes ? No 


SCHRONASCONKFANNHK OCYaANoOoCoCL 


ANN CUNFENUYUNBANEEOHHAUEE 


ph pma ph eh pmd mt a i i t 
SSBRSSe2GanEGRESvomusaneone 
MADEN ELHHELONCHUNOCHAY EE NE UNOHOHFUDS 


6 
8 
1 
24 7 2 
25 6 1 
26 6 1 
27 4 2 
28 3 2 
29 7 2 
30 0 4 
31 0 3 
ee eee al 
p the 
cians recommending that treatment = ach 
average patient. To derive this a the 
number in Table 2 is subtracted fro™ ores 7° 
remainders are a set of weights. The *esulting 
summed for the 32 decisions; the the m 
total score represents the tendency ns ae 
port to suggest to the clinician deck e basis o; 
would not have been pes ts (00 
a ye Cf ut the pa 
zero” information abo 4 by ten ie 


4. If the total score is divide jor 2 
transformation is necessary if a s 
used in Step 3, instead of raw Pie resulti”! 
cians, to derive the weights), T 
number represents the number © el.” 
sions which were “completely weasel as 
of course, a hypothetical number 
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that two “ zi 

Gt me decisions should be 

ee we : completely novel” decision 

a peor i. is made exactly opposite to the 

ti tampa aa This variable allows us 

niake B arious weighting systems and to 
use of our experimental data. 


We z 

Mar ise refer to this measure as 
sents a jan decisions. Table 3 pre- 
the decisions ae of such measures, in which 
Wii, Sieg sens tea judges for each patient are 
tion of the oe are used, this modifica- 
new, useful 5 ure is called “number of clear, 

decisions,” for reasons which will 


e elabo x 
rated in the following sections. 


T a 
he Measurement of Clarity 


The ; 
clarit , 
amount of y of 
ers, As 


aptek a report is defined as the 
a ment of two independent read- 
understood eh e concerned with utility, it is 
treatment ( at the agreement is to be about 

© more ies distinguished from, for example, 
reliability of eric categories used in studying 
1S appraised į personality judgments). Clarity 

sed in the following steps. 


LT 
-© Two clinici $ r 
Pendently ie read a given report inde- 
informatio he report constitutes their sole 
ton about the patient. 


2. F 

. ‘ol . 

to fill en the reading, they are requested 

independ tee decision check list (Table 1) 

“Don't e responding “Yes,” “No,” or 
now” with regard to each decision. 


3; g 
nunta a eigen are compared and a score, 
“Pon whic} $ hee useful decisions (the number 

tion of n they agree), is calculated. A distri- 

such scores is presented in Table 3. 


The 
é j; surement of clear, new, useful decis- 
Value Wen to compute an over-al 
Judges, wi combines the opinions of separate 
eir o Which also describes the departure 
Out E from a priori convictions 
A ment. 


the weighting system de- 
t of 


Scribe IS Purpose, 

Uti above (under The Measuremen 
is applied to those decisions upon 

Tesultj two clinicians separately concur- he 

ng measure is termed number of clear, 


w, 
useful decisions. 
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The Clarity and Utility of Nine `° 
Psychological Reports 

Nine clinical reports were selected at ran- 
dom from our files. The reports were distribut- 
ed to seven clinicians familiar with our treat- 
ment procedures. They were distributed in 
such a way that each report was read by two 
clinicians and so that no two clinicians read 
more than one report in common. 


Table 3 
Clinical Utility and Clarity in Nine Reports 
pa “i g 
$ g og S s 
2 58 #3,8 #258 
Ž caai feil frn 
Š 2533 23% messa 
A 19 9.4 .50 
B 18 10.8 60 
Cc 15 7.8 52 
D 22 12.0 54 
E 14 8.3 60 
F 11 5.2 47 
G 11 5.1 A6 
H 22 9.5 43 
o LC ā Z- 
Median 17 8.3 .50 
Per Cent 
of Total* -53 26 


¢ The total is 32 decisions. 
On concluding his study of the report, each 
clinician was requested to make the 32 decis- 
atient described in the 


ions (Table 1) for the p t 
were analyzed according 


report. The responses W 
$ described above. Results are 


e operations 

e n in Table 3. In interpreting Table 
3, we can state that slightly over half of the 32 
decisions can be clearly agreed on after reading 
the report. Of those which can be clearly 
agreed on, only half represent decisions which 
would not have been made before reading the 
report (according to Table 2). 

fourth (26%) of the list of 


‘Thus, about one 
therapeutic decisions are clearly indicated con- 
trary toa priori expectations in the average 


psychological report, within this sample of re- 
ports. It is, of course, not possible to say 
whether this is a “satisfactory” or an “unsatis- 
factory” proportion, with our present level of 
knowledge about the proper use of these treat- 


ments. 
We can, however, go on to consider the 
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problem of which features of the psychological 
report may influence its clarity and utility. 


Linguistic Correlates of Clarity and Utility? 


The clinical reports which were measured 
above as to clarity and utility were also meas- 
ured as to several factors which describe style 
and properties of the writing in each report: 
length of report (in words) 
average sentence length (in words) 
average number of technical terms (per word) 
average number of personalizing terms (per 
word) 


Pees 


The variables “technical terms” and “per- 
sonalizing terms” require definition. The au- 
thor selected from a large number of psycho- 
logical reports those words which appeared to 
be frequently found in the vocabulary of psy- 
chologists but not in the conventional speech of 
lay persons (e. g., “dysfunction”), or which, 
while appearing in the speech of lay persons, 
appear to receive meanings different from the 
meanings assigned them by psychologists (e. g., 
“ deficit”). This list contains 140 words and its 
importance does not justify its inclusion in the 
present paper. 

Frequency of technical words is defined as 
the total number of words from such a list di- 
vided by the total number of words in the 
report. Such a frequency count was made in 
each of the nine psychological reports; the dis- 
tribution of values is summarized in Table 4. 

“Personalizing terms” include all personal 
pronouns (excluding “it’), include all nouns 
that have a masculine or feminine natural gen- 
der (e.g., “nurse”) but not common gender 
nouns (e.g, not “authority”), and include 
plural nouns with a group referent (e.g. 
“folks”). This definition of personalizing 
terms parallels the definition offered by Flesch 
[4] in his readability studies. 

Frequency of personalizing terms is there- 
fore defined as the total number of personaliz- 
ing terms divided by the total number of words 
in the report. Distribution of these values for 
the nine reports studied is presented in Table 
4, 

Each of these four variables: length of re- 
port, length of sentence, frequency of technical 

The author is indebted to M. Buttiglieri and R. 


Phillips for their analysis of these linguistic vari- 
ables. 4 
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terms, and frequency of personalizing terms, 
was correlated by rank-order method with the 
variables pertaining to utility and clarity of the 
report. Results of these correlations are pre- 
sented in Table 5. This table also presents 
reliability figures for the utility and clarity 
variables. 


Table 4 
Linguistic Properties of Nine Psychological Reports 
i Report Sentence Technical Fargona 
Patient length le: t erms e 
(eee) Gece) (nee werd) tner word) 
A 730 19.7 .20 13 
B 359 15.6 22 08 
€ 467 20.3 22 a> 
D 595 20.0 22 07 
E 254 16.9 17 0+ 
F 362 17.2 18 05 
G 430 17.9 A? a 
H 604 18.3 22 ns 
I 382 22.5 23 o 
Median 430 18.3 22 -06 
Table 5 : 
Rank-Order Correlations between Clarity, Urility, 
and Linguistic Variables 
ians) 


(N=9 reports, each judged by two clinic 


ay of new? 
Number of Number eful 


Feet oar 
C elgar, megil e arisiop 

Report length -66 at 

Sentence length -.10 af 

Technical terms 64 m 

Personal terms .36 # 

Number of clear, 

useful decisions oo" 

Number of new, clear, 58* 

useful decisions - Jat- 

ents aalo” 


* These correlations are reliability coeffic! 
ed by the split-half method. 


ssoi 
A Priori Likelihood of a Decis!0' ordet 


$ n 
Because of the uniformly low rar abet of 


> “pum 
correlations involving the variable, my it 
new, clear, useful decisions ( von that t 
appropriate to question the asumpt js var? 
weighting system used in measur!” 


any ac i ip to t e ‘nS 
a a tual relationship tio! 
able has ny a : 


of clinical decision. Are the 76°" they sie 
for therapy made by clinicians exit Ta 
given no information about a Pall hich they 


rw 
2) similar to the recommendatio 
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make af Bo 
a a he information about a 
e 
ments een onstrated in previous experi- 
timers kd x t = Stating of an opinion about 
a further quë judge to “fixate” his opinion. As 
“rigidity,” e about the nature of clinical 
judgments’ bet he similarity between clinical 
oth thes s 
tlle eee (the reliability of the 
commendations). aed She rigidity of clinical re- 
in Table 6. Thi converge in the data presented 
agreement eae table compares the amount of 
Mending eich Pe ten clinicians, in recom- 
or the “hy rs the 32 treatment procedures 
With the a etical average N-P patient,” 
Same lacaat of agreement among those 
ment decisione F recommending the 32 treat- 
Teports they rez or the specific patients whose 
sion receives read. Thus, each treatment deci- 
compares the ros agreement scores. Table 6 
Ore” and a em recommendations “‘be- 
r reading reports. 


Correlatio b Table 6 

ation betw ab 

s Se ay Decisions Made about the 
Bb atient with Decisions Made 
about 9 Specific Patients 


Number of times same decision 

made regarding any specific pa- 

umber tient after his psychological re- 

aking os Sinigiany “POE Tead by a clinician + 
theta fF the: hype. 
Datigg! | Avera, h 

lent a ge N-P 


0-3 4-9 10-18 


0 
1-6 7 2 
Me EE 
` = 32 decisions 
hi square = 17.4} 
=4 
a Ten oi Significance less than .01 
ica], Clinicians 
made these decisions for the “hypo 


» Average N-P pati 
iite of decina tent” (Table 2), making a total 
wi 
CES ee Rene by Bo clinicians ; each 
Br The P total decisions for each report that he 
Oupeg, eet sonian r of eighteen sets of decisions. 
"18.76. Thi for these data, when they are un- 
T. is is a highly significant value. 
a 


ble 
‘stem a demonstrates that the weighting 
: new, clear measuring the variable, number 
oe a telatio, ra decisions, does seem to 
ion about nship to the process of clinical de- 
what treatment should be given to 
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specific patients. Whether this also demon- 
strates the strong influence of clinical bias 
upon treatment planning remains to be deter- 
mined by further experimentation. The finding 
could also be interpreted as indicating that the 
information on which reports are based (i.e., 
psychological testing) is poorly developed in 
the direction of treatment planning. 

It seems safe to conclude (a) that the 
weighting system has some reliability and (4) 
that the factor of clinical bias (among psychol- 
ogists, at least), or stereotypy of opinion, helps 
determine the role of the report in the treat- 
ment-planning process. Such conclusions have 
interest in relation to the method of measure- 


ment described in this paper. 


Conclusions Regarding the 
Measurement of Utility and Clarity 


1. The number of clear, useful decisions 
implied by a psychological report can be meas- 
ured by counting the number of decisions 
agreed ‘upon by two clinicians who have read 
the report independently. This measure has a 
split-half reliability of .59 in the small sample 


of nine reports studied. 


2. The number of new, clear, useful deci- 


sions implied by a psychological report can be 
measured by weighting each decision in (1) 
above, according to the inverse of the likeli- 
hood that such a decision could be made with 
reference to the average patient. This measure 
has a split-half reliability of 58 in the small 
sample studied. 

3. The weighting procedu 
be quite reliab 


re employed in 
le in that clini- 


(2) appears to i 
cians tended to make the same therapeutic 

a : f 
decisions after reading psychological reports 
sly made for the “average 


that they had previously ma age 
N-P patient.” This similarity between a priori 


and a posteri mendations may explain 
why greater relationships between the “reada- 
bility” and other linguistic variables on the one 
hand, and, on the other hand, the variable new, 
clear, useful information, were not obtained. 
The operation of clinical bias or rigidity may 
be so great as tO mask many of the effects of 


the psychological 
4, Suggestive but 


ships between the nu 
cisions and the length 


the report were foun 


ori recom 


d. The longer a report 
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(between the values of 254 and 730 words), 
the greater the clarity in terms of therapeutic 
implications; and, the more technical the ter- 
minology (independent of length), the greater 
the clarity. 


Implications for Further Research 

The above data and findings are presented 
only for illustrative purposes. The intent of 
this study is primarily methodological. 

‘The reliabilities of the measures of utility 
and clarity are high enough to be promising but 
low enough to require further refinement of 
the measures before large-scale inquiry is justi- 
fied. 

Limitations on the general use of such meas- 
ures are imposed by the fact that, logically, 
such measures have to be devised with refer- 
ence to the institutions within which they are 
to be used. Variation in institutional lists of de- 
cisions and particularly in a priori weights (i.e., 
clinical premises) would reduce the general ap- 
plicability of any one scale. 

It should also be emphasized that the present 
method defines only one dimension among the 
many along which the value of a psychological 
report should be calculated. A report has rele- 
vance not only to gross decisions such as those 
listed here, but also to subtler problems which 
arise during protracted psychotherapy. Other 
purposes of the report—such as establishing in 
the therapist or decision maker a clear and 
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memorable image of the patient—are not met 
by the present method. 

` Nor does the method help solve the problem 
of whether valid decisions have been suggeste 
by the report. The broader problem of whether 
utility and clarity have any relation to validity 
remains for future research. n 

The most important suggestion of the oa 

ent discussion is that the “action-potential o 
a report should be a criterion of its usefulness; 
the most important implication of our data JS 
that it is possible to measure this property: 
is possible that we may uncover empirical = 
teria which will ultimately define the languag 
which should be spoken by the clinician. 
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Intelligence Scale 


James J. 


Gallagher 


Michigan State College 


It is q a A 
eney of oes m psychology that the effici- 
validity of the Practice is determined by the 
Vidual weal clinical judgment of the indi- 
Use this jud ogist. Although called upon to 
average psy ar every day in practice, the 
Sychologist has had little opportunity 


to che 
" ck syste: à 
i tematically the validity of his own 


Judgment b 


Some diffi 
cult methodological problems. One 


his diet m which the clinician 
št ane T gment is when he is 
ienga ee give an opinion as to 
Adoption ase, oftentimes at the request of 
Pecially nada oe Good judgment is es- 
Vlous reason, ed in this situation since, for ob- 
idea] wher IS, test conditions are often far from 

l infants are being evaluated. Every 


Clinici 
lclan } . 
en has in hi 
C US or 7 yi 4 
1 Comment Hee r her reports written some 


their į 
Inte. 
in ll 


This child 
feels k child 


Would 
t 


did 
Sean te appear to be doing his best.” 
er Performance irritable that the examiner 
have been,” was lower than it otherwise 
e inf i 
ant a 
Ppeared sluggish and sleepy and 


diq 
not p 
es 
Spond to many of the items.” 


Yet the 
oe comes sap of checking these state- 
i n, © Dar y too seldom to the busy clini- 
cha termine Pose of the present study was 
an if there were any significant 


es ų 

W . “Pon ri F 

ete judged bin in a group of children who 
Binal į s not doing their best upon the 


nfant test, 


Previous Studies 


he enti 
p telecte a area of infant testing has been 
esel] 43 in psychology. Although both 
I Ta fare opmental Scales [3] and the 
ee Intelligence Scale [1] have 
chet on use for some time, little has 
concerning their validity and re- 


c e 
Ate, 
leet 


In 
been rep 


liability beyond the original presentation of 
the authors. A new scale designed for infants 
12 weeks has recently been developed 
at Northwestern University [4] but is not 
yet in general clinical use. Watson [6] has 
recently stated that no published study, other 
than that of Cattell herself, concerning the 
scale was known, although it was then ten 
years old. Since then Escalona [2] has done 
a study on the use of infant tests for predictive 
purposes. Using both the Cattell and Gesell 
scales she found that a group of children tested 
under nonoptimal conditions tended to vary 
more on retests than did a group of infants 
who were tested under what was judged to be 
ng conditions. The measure of 
change was, in this case, movement in broad 
intellectual classifications, i.€- such as from 
Dull Normal to Average. Even the group test- 
ed under optimal conditions showed a marked 
tendency to vary one intellectual degree away 
from the original test in 31% of the cases. 
Her conclusions were that for the best predic- 
tive results the gestalt of the testing situation 
had to be taken into account rather than the 
mere test finding itself. 


Method 
e present study were forty- 
three infants, ranging in age from 4.1 months 
to 24.1 months, who were seen at the Dayton 
Guidance Center over a period of three years. 
All these infants had been eo by com- 
ay agencies supervising acoP ion cases, 
Dial had taken the Cattell Scale at least 
twice. Since the general policy o£ the psychol- 
ogists was that retests of all infants were de- 
sirable, it was possible for the writer to divide 
the children into two groups: those having 
routine retest and. those who were suspected 
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from 4- 


optimal testi 


The subjects in th 
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of not doing their best on the original tests. 
The two psychologists who did the tests had 
M.A.’s in psychology plus several years of ex- 
perience. 

The writer, who did none of the actual test- 
ing, chose the children for the Mandatory Re- 
test group upon the following criteria: 

a. Evidence in the case history of extremely 
deprived environmental background up until 
the present examination (such as malnutrition, 
desertion by parents, etc.). 

b. Definite statements in the psychological 
report that owing to poor rapport conditions 
(child crying — restless — not responding) 
the psychologist believed retesting necessary. 

The children placed in the Routine Retest 
group were selected on the basis of the absence 
in the psychological reports of any comments 
indicating special problems existing in the test 
situation or in their previous environment. The 
placement of each case in its proper group was 
quite clear owing to the precise wording of the 
reports. A recheck of the placement of twenty- 
five of the cases, chosen at random and read 
two months after the original selection by the 
writer, found twenty-three of the twenty-five 
cases being placed in the same category as be- 
fore. The mean age of Routine Retest group 
at the time of first testing was 8.29 months, 
while the mean age for the Mandatory Retest 
group was 10.53. This was not a statistically 
significant difference. The mean time interval 
between the first and second test for the 
Routine group was 7.90 months and for the 
Mandatory group was 7.18 months. 


Table 1 


Test-Retest IQ Scores on Mandatory 
and Routine Retest Groups 


Measure Mandatory Retest Routine Retest 
First test 
N 19 24 
Mean $8.05 100.62 
SD 17.80 9.18 
Retest 
N 19 24 
Mean 96.58* 101.25 
SD 14.79 8.99 
Test-Retest 
correlation 77 837 
* Differen. 


ce between means significant at the 1% level 
of confidence, 


+ Corrected for restriction of range [5]. 
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Table 2 a. 
Changes in Terman-Merrill Classifications 
As Result of Retest 


Tw Three 
Two One Same One Two oe 
Test talaw ‘below category above above _ #b0 
Routine 
Retest 4 16 4 
Mandatory i 
Retest 11 7 
ine 
The standard ¢ test was used to ag 
the significance of difference tenet an 
pre- and posttest mean IQ's of each 67°., 


2 ~ -Merr 
The changes in the standard Terman mer 
[5] classifications as a result of the retes 
also calculated. 


Results 


Table 1 shows that the Mandato 
group made a mean gain of 8.53 IQ 
the time of retest, and the difference 
first and second mean IQ scores was S!% 
at the 1% level of confidence. The R 
Retest group showed a gain of .53 1Q 
on the retest, a difference that was 1° P 
tistically significant. The test-retest © t 
tion for the Mandatory group shows # ee ine 
able but not outstanding r of .77. The Ro put 
Retest group showed a test-retest r OF * range 
when this is corrected for restriction of r? 
this r becomes .83. n-Mer 

Table 2 reveals the change in Ter™ of 


etest 


. . . r 
rill classification as a result of the group” 


ry Retest 
points at 
betwee? 
nificant 
outine 
points 


a 
evenly split, four infants dropping one = ation 
cation while four moved up one € 
These results closely agreed with e 
findings of her optimal test grouP» ait , 
of her cases falling in an adjacent study: = 
compared with 33% of the preser en that 
the Mandatory group it may be z 
changes are all in the direction o se 

test classification and one infant € 

to three classifications higher- 


Conclusions ape5 
r situation ' ist 


syci 
f the P ther pe 


1. In this particula 
that the clinical judgment © 


. . sary e 
was sound in stating as weit a appe ipit 
ing for those infants who ¢ results ate“: 
doing their best. While thae he stud 
ed to the situation involve 


, 
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PC ay to note the similarity of the results 
“2 is study and in Escalona’s study. 
wiles ane noted that although the re- 
to davet e — Retest group show them 
the Ma, T more stable retest pattern than 
lishility-en stony Retest group, their own re- 
Puig : cannot be considered too good for prac- 
: ees sega All doubtful cases should 
firosgantan ac rather than risk damage to a 
Ons, ve adoption case by too much reliance 
3 useful but not overly reliable instrument. 
isn, ae seems to support the conclu- 
nde at : 9 possible information concerning 
tonii a results but the conditions sur- 
necessa i c test and full case histories are 
Hee ary tor adequate competence in the pre- 
‘on of infant intelligence. 
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Three Factors in Parent Behavior 


Maurice Lorr and Richard L. Jenkins 


Veterans Administration? 


ehavior- 


The importance of the family and the role basic “armchair” factors of parent b ollow- 


of the parents in the personality development The eight factors or areas describe the 


š 3 : ild and 
of the child have been widely recognized. Much ing: home atmosphere, contact of child a D 
clinical evidence has accumulated with regard mother, babying and protectiveness, a Pe 
to the influence of parent attitudes, and to the and evaluation of the child, readiness pit 


effect of various methods of handling, on the planation, emotional relationships 


, ; ‘ ` roup. 
child’s emotional development. However, un- parent and child, and a miscellaneous g 


z i A ; F ed- 

til recently, comparatively little systematic Baldwin, eż al. [1], using the rating oie 
effort has been directed toward the identifica- ule developed by Champney, secure tt A 
tion of basic variables in parent behavior. by home visitors on factors in each home * 


The Fels Parent Behavior scales developed population whose children were also | 
by Champney [2] represent an effort to cate- studied in other ways. Subsequently, oo 
gorize and measure a wide range of family effort to secure simplification of the tors 
variables. The variables covered in the 30 ables, Roff [3] isolated seven common fac 
rating scales were intended to measure eight by means of a multiple factor analys's 


* F ren 
1From Veterans Administration Central Office, iMtercorrelations between the Fels Pa 


Washington, D.C. havior scales obtained by Baldwin. 
Table 1 
Matrix of Correlations of Primary Factors vil 
I IL Ill IV v w 
Concern for child I 1.00 
Nonreadiness of suggestion II —.36 1.00 
Democratic guidance Ill at 06 1.00 
Parent-Child harmony IV 38 AL 63 1.00 
Nonpermissiveness vV —.36 .14 ~.34 -.36 1,00 1,00 00 
Activeness of home VI .03 -.11 27 .04 36 “06 L 
Sociability of parents VII .23 .26 “a2 06 22 - 
Table 2 
Rotated Oblique Second-Order Factor Matrix ryg 
and Transformation Matrix y;, 
vio Z 
Ttg Y 6 
Rating Scales X T Z x 916 as 
Concern for child I 781 012 092 La B a 
Nonreadiness of suggestion II 578-338 «= -.012 Tae 147 a2 
Democratic guidance III .022 770 -001 oie eth 
Parent-Child harmony IV .011 592 -236 “096 633 Be 
Nonpermissiveness v -.068  —.448 .601 7A -198 60 
Activeness of home VI .134 -.153 569 F —.007 


Sociability of parents VE -001 -.005 440 
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Three Factors in Parent Behavior 


Factor Loadings of Rating Scales on Second-Order Factors 


Rating Scales 


Babying: 
abying: overhelps — withholds help 


Child-c 

en : 

ine of home: child-centered — child-subordinated 
ess for child’s welfare: anxious — nonchalant 


Protecti 
ine sheltering — exposing 
ity of contact: vigorous — inert 


uration of k 
contact with parent: extensive contact — brief contact 


cce : 

oS ten child: devotion — rejection 

emocracy of igs suggesting — nonsuggesting 

dcesisiveness . Te democratic = dictatorial 

UStificatio o suggestion: optional — mandatory 
n of policy: rational — arbitrary 


Onrestricti 
veness of regulations: freedom — restriction 


Onemotionali 
aenda E toward child: objective — emotional 
ess of criticism: uncritical — critical 


eadiness 
of A . me Pee” 
explanation: satisfies curiosity — thwarts curiosity 


“avora! se s 
Straten of criticism: approval — disapproval 
larity of E of child’s problems: keen — obtuse 
ondisciplin, icy: clear — vague 

ectlohute aa triction: concordant — contentious 
apport we oe child: affectionate — hostile 
ondiscond ieee close rapport — isolation 

estiveneie ome: harmony — conflict 
eadiness ae pet lcs successful — unsuccessful 
everity of orcement: vigilant — lax 

a actual penalties: severe — mild 


Ccelerat; 
onal attempt (pushing) : acceleratory — retardatory 


oordinati 
i tion of household: coordinated — chaotic 
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Table 3 ° : 

x Y Z 
651 -.006 054 
640 -.025 078 
622 133 035 
600 023 245 
576 2035 +060 
556 054 019 
438 .280 015 
385 —.294 .061 

-.039 764 -.087 
-.029 435 -.033 
019 696 -030 
-.294 -661 -.262 
-.204 625 -.211 
—.263 617 -.327 
-060 .586 .198 
.199 572 004 
~.027 490 256 
-001 461 262 
080 AA -.145 
321 387 -.130 
312 347 -.128 
-.019 328 124 
108 299 -.063 
016 —.318 .592 
-.079 -425 = 473 
.123 .229 427 
.079 074 407 
153 -.138 394 
.030 .098 369 


Ctiven, 
8 ess of h A : A 5 
Justment of ome: active — inactive 


Sociability of p ome Well-adjusted — maladjusted 
of family: expansive — reclusive 


T 

ering tot isolated were interpreted and 
Ruidance S concern for the child, democratic 
ny, isthe vens parent-child harmo- 
ness of ss ity adjustment of parents, active- 
e corka and nonreadiness of suggestion. 
aS determi ations between these primary factors 
Exami ned by Roff [3] are shown in Table 
Sortelations bow of the table reveals substantial 
an mS between these factors. It appeared 
Teveal gigs of these correlations should 
.2Ctors of, or more underlying second-order 
Mterestin a broad character which should be 
Ncepey i in themselves and useful for the 
cording alization of parent-child relations. Ac- 
Were sy Y, the intercorrelations in Table 1 
Orthogo jected to a centroid analysis and three 

to obj nal factors were extracted and rotate: 

nee sumple structure. 

Order ie 2 presents the loadings of the first- 
actors on the second-order factors. It 


-— 


—.056 


also gives the transformation matrix for com- 
loadings of the original 30 


puting the factor 
rating scales on the second-order factors [4]. 
Tt will be noted that the significant loadings 


on Factor X are from concern for the child 


and nonreadiness of suggestion. 
with the largest loadings on 


The variables the l 
r Y are democratic guidance, parent-child 
and permissiveness. Nonreadiness of 


suggestion also has a sizable negative loading. 

The heaviest loading on factor Z is a load- 
ing from nonpermissiveness. Activeness of the 
home and sociability of the home also show 


large loadings. 
The character of these second-order factors 


learer when we reter to Table 
3, which presents the correlations of the origi- 
nal 30 family characteristics with the second- 
order factors. The largest correlations with 
factor X are babying, child-centeredness of the 


facto 
harmony, 


becomes much cl 
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home, solicitousness for the child’s welfare, 
protectiveness, intensity of contact, duration of 
contact, and acceptance of the child; devotion 
rather than rejection. It would appear that 
this factor might be characterized as the satis- 
faction and encouragement of the child’s emo- 
tional dependence on the parent. We will call 
it dependence-encouraging. 

The second factor, Y, is best described by 
democracy of policy, noncoerciveness of sug- 
gestion, nonrestrictiveness, nonemotionality 
toward the child, nonreadiness of criticism, 
readiness of explanation, favorableness of 
criticism, understanding of the child’s prob- 
lems, clarity of policy, and the absence of dis- 
ciplinary friction. This is clearly a factor of 
democracy and democratic values in child 
training in contrast with undemocratic meth- 
ods. This factor will be called democracy of 
child training. 

The third factor, Z, is characterized by 
vigilance of enforcement, severity of actual 
penalties, accelerational attempt (pushing), 
and coordination of household. Activeness of 
the home, the adjustment of the home, and 
the sociability of the family show smaller cor- 
relations. This is a factor of organization and 
effectiveness of control in the home. It ranges 
from a strict orderliness at one extreme to a 
chaotic disorder at the other. 

It would appear from this analysis that, if 
we are to seek in clinical work to conceptualize 
parent-child relations in shorthand fashion, 
the three most economical questions we may 
ask ourselves are: 

1. How far does this home sustain and 
encourage dependence and how far does it deny 
satisfaction to dependence? 

2. How far do its methods of child train- 
ing reflect democratic practices and values, or 
to what extent are they authoritarian and un- 
democratic? 

3. To what extent is there a strict order- 
liness in the home or to what extent is the 
home lax and unorganized? 

We must recognize, of course, that these 
three questions, based on the second-order fac- 
tors, would not yield us all the information we 
would obtain from ratings on the seven first- 
order factors, any more than the latter would 
give us all the information we would obtain 
from ratings on the 30 schedules from which 


Maurice Lorr and Richard L. Jenkins 


they were derived. Busy clinicians, however, 
can hardly afford routinely to make ratings on 
the 30 schedules, unless they are pursuing this 
as a research project, We submit that 1n terms 
of our present knowledge the three foregoing 
questions embody more of the significant 
elements of the larger study than any othe 
equally economical condensation. 

The intercorrelations between the me 
second-order factors were also computed. TE 
correlation of —.43 between factors X and 
imply that the home with democracy of poia 
tends not to be dependence-encouragins- Z 
correlation of —.47 between factors am ü 
suggests that a democratic policy is relate Sa 
a home that is less organized and less efect 
in the enforcement of its policies than z 
authoritarian home may be. Factors li 


. . . . > i o sig- 
are independent, indicating that there 1$ ‘oi a 
nificant relation between the encourage™ ness 


wë 
dependence on the one hand and effect! 
of control in the home on the other. 


Summary 
A second-order factor analysis of derive 
terrelations of seven first-order factors Scales 
by Roff from 30 Fels Parent Behavior sign 
indicates that the most economical 47 Jation® 
ficant condensation of the significant ro i 
tapped by these scales can be represen 
the following three questions: „gad 
1. How far does this home sustat” jt deny 
courage dependence and how far doe , 
satisfaction to dependence? pid e 
2. How far do its methods of e aluss 8 
ing reflect democratic practices 210 pnd W 
to what extent are they authoritarian i 
democratic? ct order!" 
3. To what extent is there & vale he ho” 
ness in the home or to what extent E 
lax and unorganized? 
Received November 6, 1952. 
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Follow-up Study of Ten-Year-Old Boys 
with Police Records 


William W. Wattenberg and Frank Quiroz 


Wayne University 


The pr 
Sede at is an attempt to check 
indings of à some inferences drawn from the 
tenberg [3]. 5 ope, see reported by Wat- 
oys who had ae relating to eleven-year-old 
É Detroit oli arpes filed against them with 
cated that nEn e collected. These indi- 
neither severe y of the boys were victims of 
ad environme te disorganization nor 
Conduct Sk 7 pressures. Rather, their mis- 
3S resulting on: ly could be accounted for 
m poor judgment, weak internal 


Contr 
ols, or ; aan 
Could bas other immaturities which they 


liey; 
Ving this 
: is 
Writers [ could be the case. Several recent 


Cence A 
s maintai 1 
ntain that this period of development 


a normally developing youngster to 
adult-prohibited actions. These 
necessarily be symptoms of serious 
though maladj ustments or character defect. 
to the att such actions might bring a youngster 
Predictive of of the police, they would not be 

Wos : „delinquency in subsequent years- 
cence as Pecific trends attributed to preadoles- 
2ation a growth phase are: (a) a disorgani- 

(b) a ci the childish personality structure an 
“ngage i rong attraction to peer groups which 
adults, Ba species of guerrilla warfare against 
Ting a ~ither trend, if it exists, could easily 
Of lay, Youngster into collision with the forces 
Porary and order, Both, presumably being tem- 
ing po Cventually wane. Delinquency result- 
peg om either or both would therefore be 

f ted to vanish, 

has mae ‘8 any truth in these speculations, it 
ime, ching tical implications, At the present 
5 serving youth are badly overloaded 


in most areas. A good portion of their load con- 
sists of children referred by courts or brought 
by parents who have been disturbed by juvenile 
misconduct. Now, if in this load there is a large 
proportion of boys and girls who would have 
recovered even if nothing had been done for 
them, the overworked clinics are wasting prec- 
ious time and even more precious skill. If such 
should be the case, then an obvious next step 
would be to search intensively for some reason- 
ably effective means of discovering which pre- 

inely in need of therapy. If 


adolescents are genul 
this could be done, then clinics could concen- 


trate on those youngsters who would become 
delinquent or mentally ill if they received no 


treatment. 


From the viewpoint of scientific research de- 


signed to evaluate methods of psychotherapy 
the possibility we have been discussing has 
grave implications. If among the populations 
receiving treatment there is a large proportion 
who would have improved in the course of time 
without therapy, statistics based on percentages 
of “success” become meaningless. As a mini- 
mum precaution research workers would have 
to make allowances for the existence of this 
factor. 

The study 
evidence that 


[3] mentioned contained indirect 

preadolescent boys in trouble 
with the police included a large proportion who 
were relatively normal youngsters. However, 
the data were neither gathered nor ordered in 
such a way as to give an estimate of how large 
the “normal” group might be nor to verify the 
hunch that they would recover “spontaneously” 
from their current misbehavior. Accordingly, 
it was decided to take a sample of ten-year-olds 
who had police records and to make a follow-up 
study to discover how many of them did con- 
e e delinquent. In addition, an effort 
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was made to discover what available facts 
gathered at the time of their first police con- 
tact distinguished between those who continued 
to get in trouble and those who later had no 
police records for a twelve-month period. 

For the purposes of this study, we accepted 
the following hypotheses as representing the 
points to be tested: 

Hypothesis No. 1: In a group of ten-year- 
olds with police records, only a small fraction 
will be found two years later to be continuing 
to act as delinquents. 

Hypothesis No. 2: The group which contin- 
ues to act as delinquents will be distinguished 
by having greater pressures in the form of bad 

family situations, poor school relations, and 
bad neighborhood influences. 


Procedure 


Use was made of the very comprehensive rec- 
ords kept by the Youth Bureau of the Detroit 
Police Department.t The records for 1948 
were searched, and all those pertaining to boys 
ten years old at the time of their first contact 
were segregated. These records were then 
placed in order by the serial number assigned to 
the boys. Next, the records of all boys contact- 
ed by the police during 1950 were placed in 
serial number order. The two lists were checked 
and the original records of all boys among 
our original ten-year-olds who had police con- 
tacts in 1950 were set aside. We termed these 
boys “repeaters.” The nonrepeaters, then, were 
boys who after a period of at least one year 
(but averaging eighteen months) had gone for 
a full twelve months without any complaint 
against them having been made to the police. 
The year 1948 was chosen because at the 
time the routine handling of ten-year-olds was 
either to release them to their parents with a 
warning or to have them come in to visit police 
officers weekly for a series of check-up confer- 
ences. Only where the offense was very serious 
did the police officers file a petition with the 
Juvenile Court. At the time, the clinic attached 
to the court had a heavy backlog of cases. With 
rare exceptions, notably in the instance of sex 

1The authors wish to express thanks to Senior 
Inspector Sanford Shoults, Inspector Ralph Baker, 
and Lieutenant Francis Davey for their contribu- 
tion to this research. They were responsible for 


maintaining the records used and were helpful in 
making the basic tabulations possible. 
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offenses, the first offenders were put on proba- 
tion without being seen by the clinic. There- 
fore, it is safe to say that only a tiny fraction 
of the 1948 ten-year-olds had received system- 
atic psychotherapy. 

To test the second hypothesis, the repeaters 
and nonrepeaters were compared on 50 items © 
information reported in the Youth Bureau 
“history sheet,” filled out by selected police 
officers after a visit to the home, an interview 
with the boy, and conferences with school per- 
sonnel. For each item a tabulation was prepares 
and tested for statistical significance by the chi- 
square technique. In these comparisons 0? 
the records made at the time of the first PO Ic 
contact were used. 


Findings f 
‘ o; 
In all, the 1948 files contained recor, 
h the Po 
he grouP 


had gone a full year without any repo 
lapse into actionable misconduct. thesis- 
furnish strong support to the first hypo 


5 an 
epeaters ^ 
i: FORE secte 


In the comparisons betweer 5 
3 d be reje 
a 


repeaters, the null hypothesis coul 
the 1 per cent level of confidence for (e 
at the 2 per cent level, for an additional E The 
and at the 5 per cent level, for four ™ 

chance expectation would call for 2. f statis” 


to meet this criterion. Thus, the number a reat 
tically significant differences was 200 R vee, MBUE 
er than should have occurred by oe ac that 
However, these results are clouded by mn in- 
although classifications were combined, yne ' Gs 
stances of apparent statistical nET ell “lt 


chance expectation in the critical © 
five. For what they may be worth, 
results will be reported. 


tw 
na ables, 

Of the apparently significant a able a 

r As shown ' 1 alco 
concerned the parents. £45 

among the few boys for ghon 

holism was reported, amor iri 

among the boys who were sti shov 


0, as rent 
i s later. Also are! 
lice records two year hose P’ lice? 


NBN a 
Table 2, the majority of =o y the Policy, 
ratt he 
ere regarded as uncoopera; ot 
w As indicate by in pot” 


also repeaters. i 
ereun ag Soe to chi square, est con 


e, rt $ 
umn, “Contribution to ©” the hig nce 
these tables, the cells yelding e ha we 
tribution to the chi-square = pe results 


i us 
expectations below five. Thus, 
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be i d 
consider: i 
ed suggestive, but not conclusive, 


Homes in Whiel Table 1 
ich Excessive Drinki 
Abuse of Boy ei ae 


Excessi = 
rinking. Total Runner Contribution 
anaes on- to 
Present = epenters repeaters chi square 
ot pres K 3 
bi present 197 3 A 4.67 
= rinse 3 40 157 0.03 
a 0 3 
207 3 1.50 
= 6.60; 4 H 164 6.20 
i df= 2; 005 > p > 0.02 
Table 2 


Attitude of Pa 
arents toward Police Officer 


Attitude 7 
e Total Nume Contribution 
0 
Cooperative Repeaters repeaters chi ae 
“ee is 34 156 0.81 
: 9 8 8.17 
X? = 8.99 = 43 16+ 3.99 
“eh ap RST; p< GOL 
Ty ; ` 
vO of 
sc the signi 
hool, As show significant tables related to 
aa who ii in Table 3, almost half of 
K es in school ten, were receiving failing 
0, continued to get in trouble. 


>» as sh 
own i Y 
n Table 4, a similar propor- 


oys wh 
O Y s . . 
hi vere in special classes (in 


De 
Ctroit th; 
this n 
S mea 
ans classes for mentally retarded 


Table 3 
i School Marks 
hool m, à 
ark; 

FS S Total Nuinbes Contribution 
300, on- to 
Ay d Repeaters repeaters chi square 
P, iage 27 3 
por wm 241.83 

le BOSO 


Table 4 
Grade in School 


5 41 
at or hs a 9 32 0.16 
b 14 55 0.00 
13 69 1.20 
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youngsters) became repeaters. Here again, 
however, the statistical significance of the re- 
sults is clouded by the small numbers involved. 
The statistical fault does not pertain to the 
results reported in Table 5. A high proportion 
of the repeaters had two or more brothers. The 
statistical significance is clear. Interestingly, 
there was no such relationship with number of 
sisters. Another index to living conditions, the 
type of dwelling unit occupied by the boy’s 
family, as shown in Table 6, was also related 
to repeating. Those boys who lived in apart- 
ments or rooming houses were prone to become 
repeaters. The chance expectations in the key 
cells of this table were amply large to warrant 
a rejection of the null hypothesis without cavil. 
A third item related to family economic condi- 
tions was the need for a boy to employ part of 
his funds for clothes, maintenance, or similar 
uses. Among ten-year-olds this is rare, as indi- 
cated in Table 7. It was more prevalent for 
those boys who later became repeaters, but the 
numbers concerned were too small to warrant 
accepting the chi square at its face value. 
a strange his- 
eries begun at 


Throughout there has 
topics to be investi- 


The last item to be 
tory. The present study i 
the request of police officials. 
been much give and take on 
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Type of Dwellin 
Number Contribution 
Total Non- _ to 
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Table 7 
Boy’s Disposition of Money 


Number Contribution 
Total Non- _ to 
Repeaters repeaters chi square 


Disposition 


All spent for 

sienna 193 37 156 0.31 
All or part 

required for 

clothes, main- 


tenance, etc. 14 6 8 3.82 
Total 207 43 164 4.13 
x? = 4.13; df—=1; 0.05 > p > 0.02 


gated. When the “history sheets” from which our 
data are taken were designed, the police seemed 
anxious to include a judgment as to the “type” of 
a boy. One of the “types” they listed was “Peck’s 
Bad Boy,” by which they meant a youngster who 
frequently did things which angered the adults of 
the neighborhood. Although hardly the sort of 
“type” that had meaning to psychologists, it was 
included as a token of our willingness to accept 
police estimates of what was important. It must be 
confessed that it would be more accurate to say the 
item was kept in to humor the police. The fact is 
that in all of the studies we have made, this item 
turns out to be highly predictive. Whatever it is in 
a boy that makes an experienced policeman check 
him as a “Peck’s Bad Boy,” 
of behavior trends which do indicate an important 
and persistent propensity toward delinquency. As 
shown in Table 8 this item once again proved pre- 
dictive. The numbers involved were sufficiently 
large to warrant rejecting the null hypothesis at the 
1 per cent level of confidence without reservation. 
Remember in this case the judgment was recorded 
at the time of first contact and proved predictive 
of conduct two years later. 


it involves recognition 


Table 8 
“Type” of Boy 


Number Contribution 
“Type” Total Non- to 
Repeaters repeaters chi square 

Normal 143 21 122 3.42 
“Peck’s Bad 

Boy” 52 20 32 9.34 
All others 12 2 10 0.44 
Total 207 43 164 13.20 

x? = 13.20; df=2; p<0.01 


Although detailed examination of the tables 
did bring out some predictive items, these did 
not fall into the pattern required to support our 
second hypothesis. The findings in relation to 
home and school conditioris were inconclusive. 


Clear-cut results pointed to frequent tap 
(as implied by living in rooming houses) a 
presence of many brothers, and the mig z 
strong adult-annoying characteristics as diffe 
entiating the repeaters from the nonrepeaters. 


Discussion 


The major finding of this study is that or 
a small proportion of ten-year-olds agains 
whom complaints are registered with the po- 
lice continue to get in trouble. Before nner 
this as bearing on the point that preadolescen 
misconduct may be symptomatic of conditions 
which are self-correcting or which disappear a 
a result of maturing, we must weigh the possi- 
bility that many of these boys lacked police en 
tacts because they had moved from Detroit © 
that they may have received therapy. 


Three facts would seem to indicate that migrate 
from Detroit was not a significant factor. a fo 
rooming house occupants, the group most Like rd 
be on the move, were more heavily g 
among the repeaters than the nonrepeaters- pee ie 
the period, 1948 to 1950, was a relatively stable hë 
during which there was little emigration from ly 
city. Third, the fact that there were statistic? 
significant differences not related to economic ai 
cumstance differentiating between repeaters the 
nonrepeaters would nullify any contention ot 
two groups were alike except that the aided can 
happened to leave the police jurisdiction. oat-Gloe 
safely discount the argument that the ten-Y¢ 
had left town in any major proportion. 


wal 
As to the possibility that they had rece’ 
therapy, here we cannot be as confident. indi- 
indications that this was not the case ma the 
rect. As previously mentioned, referral d for 
court clinic in 1948 tended to be — fen- 
unusual cases, especially those having se? a 
ses. Our data did include the offense coun 
which the boys were charged. On Se 
there was no significant difference hepe there 
repeaters and the nonrepeaters. Howev"") 
is no way of knowing exactly what ¢ 
did as a consequence of a boy getting 
We do know that during this pe! split cou, 
arrangement existed whereby the dls 
get speedy action on any TEO u 
agencies and that this machinery 0 
only four cases. As far as the Pde of the so- 
show, there was almost no use ma it for the 
cial and clinical resources of Ee n ge 
boys with whom we are concerned. 


in tro 


a 


neral, 
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these services have been brought into the pic- 
ture for the older youngsters who have longer 
records and whose families have given up hope 
of doing anything on their own. For the 20 
per cent of the ten-year-olds who have become 
repeaters, this is most unfortunate. 


Summary 


A follow-up study was made of 207 boys 
who as ten-year-olds in 1948 had been the sub- 
jects of complaints to the Detroit police. Only 
43 of this group had been in trouble with the 
police during 1950. The items recorded at the 
time of the first contact which proved predic- 
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tive of repeating were (a) having two or more 
brothers, (4) living in an apartment or room- 
ing house, and (c) having a reputation as a 
“Peck’s Bad Boy.” 
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A Note on the K Scale of the Minnesota Multi- 
phasic Personality Inventory 


Anders Sweetland and Herbert Quay 


Florida State University 


The Minnesota Multiphasic Personality In- 
ventory (MMPI), designed by Hathaway and 
se McKinley [3], is a 560-item inventory com- 
prised of several scales designed to measure in 
the areas of: hypochondriasis (Hs), depression 
(D), hysteria (Hy), psychopathic deviate 
(Pd), masculinity-femininity (Mf), psychas- 
thenia (Pt), paranoia (Pa), schizophrenia 
(Sc), and hypomania (Ma). It also has four 
“validity” scales, designed to measure test-tak- 
ing attitudes. Among these is the K scale [5]: 
a measure of “plus-getting” (a tendency to get 
poor MMPI scores) and “defensiveness” (a 
tendency to get good scores). 


Despite the recommendations of several 
investigators [1, 7, 9], most clinicians will still 
venture profile diagnosis of the MMPI. Al- 
though the evidence indicates that the profile 
should be used mainly to differentiate between 
the neurotic, the psychotic, and the normal, we 
hazard that few psychologists will be able to 
avoid searching the profile for clues about a 
client. Since profile analysis seems to be inevi- 
table, it seems axiomatic that it should be as 
adequate as possible. 


Clinicians tend to approach the MMPI pro- 
file by one of two avenues: (a) as a nosological 
aid, or (b) as a projective technique. The 
latter generally begins with a careful considera- 
tion of the test items, With these well in mind 
the various scores become a frame of reference 
rather than a measure of hypochondriasis or 
hysteria. It is presumed that the empathetic 
counselor, knowing the items well, can “slip on 
the garb of the profile” and view the world 
through the eyes of the client. This, patently, is 
not rigorous psychology, and few pretend that 
it is. On the other hand, profile analysis of this 
kind can be uncannily accurate. 

Profile analysis of this second type is not as 


esoteric as it sounds. The clinician thoroughly 
familiarizes himself with items in the eer 8 
subscales. A high score tells him that a EA 
lar set of items was answered in a given ma 
ner. A low score indicates the opposite. I i 
of learning the items is facilitated by the fa 
that most of them are about what is expecté o 
There are exceptions, but in doubtful cases 0? 
can refer to the aberrantly scored items. | elf 
The K scale, however, does not lend na 3 
readily to this practice. The items fall into 9 
apparent pattern. If they suggest anything, 
they seem to deny having pathological a 
toms. As a consequence, the clinician uses a 
scale for what it was designed: as a contro 
test-taking attitude. as 
The possibility that the K scale might mea 
ure something other than test-taking attit = 
was suggested by its fluctuation during a re- 
periment with hypnotic dreams [8]. T E 
sults indicated that symbolized dreams ki 
produced by well-adjusted people and adjust- 
maladjusted people. The measures of rity- 
ment were the MMPI and the Social S E 
Insecurity Test (SI) of Maslow, Hirs Y saven- 
and Honigman [4]. The SI is a qaar sacia 
tory designed to measure in the area O 
security. : ent 
othe eurehations between the -= o 
scales of the MMPI and the number S but all 
lized dreams were low (Circa —:3 Jation be- 
were negative. In contrast the cora p 
tween K scores and symbolization na 
positive (.72) as was the ee 
the SI and symbolization (.57). dream $ 
was that K correlated high with ed only bY 
bolization and the latter was produc 
well-adjusted people. 
The dream experiment was meteai TË 
slightly different conditions. The sta! 
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Note on the K Scale of the MMPI 


sults were essentially the same: high correlation 
between K and SI scores when paired with 
symbolization and negative correlations be- 
tween symbolization and the adjustment scales 
of the MMPI. The relationships were evident- 
ly not due to chance behavior of the data. 
Apparently K was a measure of adjustment. 
„Asa check, the K scale and the SI were 
given to seventy-five college students. The re- 
sulting correlation was 0.68. A second sample 
of ninety-one college students yielded a correla- 
tion of 0.74.1 It would seem from this that the 
scale measures in much the same area as the 


: Two places in the literature suggest similar 

misbehavior” of the K scores. The first was in 
the work of Gough [2], whose data suggest 
that when faking is attempted, K scores are de- 
Pressed in a marked fashion although K scores 
of psychiatric groups ordinarily are slightly be- 
low average. (This was inferred from his data. 
Faked profiles show F—K scores of 14 to 41 
While bona fide scores from normal and psychi- 
atric groups range from—3 to —9.) 


Gough’s data, conforming with that offered 
Originally by Meehl and Hathaway [5], also 
indicate that college students are characterize 
by elevated K scores. His average K is approxi- 
mately 18 for this group (again inferred from 
his data), while K for average adults is approx- 
Mmately IL 

A factor analysis of the MMPI by Wheeler, 
Little, and Lehner [9] provides another oppor- 
tunity to consider the K factor. Like Meehl 
and Hathaway they find that K before factor- 
Ing correlates negatively with all the subscales 
except Hy, Similarly, they find a marked nega- 
tive relationship when correlating K with Pt 
and Sc. (The range is from —.55 to —-67)- 
The inference seems to be that the K scale 
Measures something in common with the Hy 
Scales, but something opposite the Pt and Sc 
Scales, 

In the factor analysis, K again appears to ie 

ave unusually. With the exception of the 
Second factor extracted from the normal ed 
~~ Never appears in the same factor as Hy, an 
ìt is the only scale that yields high negative 

1 The correlation betveén: Me ie sa lang 


md Scale of the MMPI was 
Ween K and the MMPI SIF scale .48. 
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loadings. Further, it tends to be significant 
only in the first factor extracted, a factor 
which has high positive loading of Pt and Sc. 

Our interpretation differs somewhat from 
that of Wheeler et al. They interpret K as rep- 
resenting ego “defense.” We believe that a 
more logical interpretation might be made by 
considering K as being one end of a continuum 
with Pż and Sc at the opposite end. This is 
based on the fact that when K and the other 
two scales appear in the same factor, the K 
loadings range from —.60 to —.70 while the Pr 
and Sc loadings are .90 and higher. From this 
we venture that what is measured by the K 
scale is the opposite of that measured by the Pz 
and Sc scales. We owe Wheeler, Little, and 
Lehner an apology for selecting this limited 
aspect of their excellent study. The interested 
reader is urged to consult the original article. 

One further clue is provided. In a follow-up 
study [6], the hypnotic dreams were rated as 
being “extrapunitive,” “intrapunitive,” “im- 
punitive,” and “no feeling.” The correlations 
between these and the K scores were: extrapun- 
itive, —.81; intrapunitive, —.33; impunitive, 
—.20; and no-feeling, +.61. The no-feeling 
dreams were produced chiefly by the well- 
adjusted subjects. The results suggest that K 
tends to be opposite from extrapunitiveness and 
closely associated with good adjustment. Al- 
though the two highest correlations are reliable 
at the 1 per cent level, the interpretation is 
made with caution because of the small sample: 
dreams = 405, subjects = 16. 

Summarizing these bits of information we 
might say that normal K scores seem to be asso- 
ciated with: (a) social security; (b) emo- 
tional adjustment; (c) a tendency to symbolize 
hypnotic dreams; (d) being a college student; 
(e) nonfaked profiles; (f) the opposite of 
what is measured by the Pt and Sc scales; (g) 
nonextrapunitiveness. 

If we were to characterize the person de- 
scribed by this summary, he would appear to be 
a therapeutic ideal: a person who is comforta- 
ble in his social contacts, above average in 
intelligence, and little bothered with doubts 
and indecisions. He seems to have an ability to 
live each day as it comes and to “sleep well o’ 
nights.” The indication is that this is a core 
part of his personality and not a facade that he 
erects to enable him to meet the day. 
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In view of the above, again emphasizing that 
the data are tenuous, it is our feeling that K 
measures not only the degree of “defensive- 
ness” or “plus-getting” with which a person 
takes the MMPI, but that it may also be a 
measure of healthy emotional adjustment. 


Summary 


The possibility that the K scale of the 
MMPI might measure something in addition 
to test-taking attitude was discussed. The sug- 
gestion was made that K scores, when within 
normal ranges, may possibly be a measure of 
personality integration. 
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The Archimedes Negative Aftereffect as an 
Indication of Memory Impairment 


Lloyd S. 


Standlee 


Institute of Educational Research, Indiana University 


Visual fixation upon a slowly rotating Ar- 
chimedes spiral produces the illusion of expan- 
sion or contraction. Which illusion is experi- 
enced depends upon the direction of rotation. 

he opposite illusion (negative aftereffect) is 
o enient] when the gaze is transferred to any 
: dor fed object. With clinical judgment as 
inä ee of memory impairment, Freeman 
betta ce TEONE cscs strong probability of 
the ve between the negative aftereffect of 
An Boker [Archimedes] spiral and the im- 

ment of memory” [1, p. 797]. 

he present experiment utilized a more ob- 
of this We oa to further test the possibility 
Non ae cron between a visual phenome- 
Choticg” memory ability. Twenty-five “psy- 
ability ae 16 “normals” were tested on 
and on the vec the negative aftereffect 
Whois oe Scale [2]. The 

S were tested again approximately 


“ight 


Shock Ours after the administration of electric 


All 
2egatiy, 


Te 
Pang 
Seg, 


of the 25 psychotics experienced the 
nyag e reffect in the first testing session. 
ing three experienced it for both the ex- 
Ond t and the contracting illusion in the 
the ex esting session. One experienced it for 
trage nding illusion only; one for the con- 
Mig rien illusion only. All of the 16 normals 
ee T the negative aftereffect for both 
anding and the contracting illusion- 

a Psychotics averaged 71 MQ before 
Mo Mt 75 MQ after shock. The gain of 4 
fidence is significant at the 1% level of 
ibe te (t test on individual MQ gains): 
paing paal averaged 120 MQ points. Com- 
plow i € two groups, the MQ’s ranged from 
nits 8 to above 143—the upper and lower 
bi Th °f the Wechsler Memory Scale- 

ilig YS: Freeman and Josey’s “strong prdba- 
Correlation” between the visual phe- 


T 
Shog he 


nomenon and memory ability is not confirmed. 
All but two subjects were perfect in their abil- 
ity to experience the negative aftereffect. In 
memory ability, however, the subjects were 
distributed fairly evenly through the entire 
range of Memory Quotients on the Wechsler 
Memory Scale. In other words, memory im- 
pairment to the extent of below 48 MQ does 
not prevent a person from experiencing the 
negative aftereffect. 

The second testing session was included to 
determine whether memory ability would be 
impaired following electric shock. If the 
Wechsler performance and ability to experience 
the negative aftereffect were to drop, an addi- 
tional measure of memory impairment would 
be available. Such was not the case, however. 
The MQ’s improved significantly (in the sta- 
tistical sense), and the visual phenomenon was 
not affected. Though the improvement in 
MQ's was statistically significant, it was con- 
founded with practice effect. Therefore, it can- 
not be concluded that memory ability was im- 
proved by electric shock. It can be said, how- 
ever, that memory ability was not impaired. 
oncluded (a) that electric shock does 
not impair memory ability; (b) that electric 
shock does not impair ability to experience the 
Archimedes negative aftereffect; and (c) that 
there is no relationship between memory ability 
and ability to experience the Archimedes nega- 


It is c 


tive aftereffect. 
Received April 6, 1953. 
Early publication. 
References 


Freeman, E., & Josey, W. E. Quantitative vis- 


Li 
ual index to memory impairment. Arch. Neurol. 
Psychiat., 1949, 62, 794-797. 

2. Wechsler, D. A standardized memory scale for 


clinical use. J. Psychol., 1945, 19, 87-95. 


317 


Books 


Baker, Harry J. Introduction to exceptional child- 
ren. (Rev. Ed.) New York: Macmillan, 1953. Pp. 
xvi + 500. $5.00. 


A college textbook planned for the training of 
school personnel. Exceptional children are often a 
complicating problem to the smooth running of the 
classroom. Baker deals effectively with the problems 
of unusual or handicapped children and seeks to 
give a teacher an awareness of their educational 
needs. The present edition is a revision of the orig- 
inal publication of 1944, There have been only a 
few minor changes in content, but the bibliography 
and index have been revised and brought up to 
date. — B. M. L. 


Blum, Gerald S. Psychoanalytic theories of person- 
ality. New York: McGraw-Hill, 1953. Pp. xviii 
+ 219. $3.75. 


In so modestly brief a volume, it is something of 
a surprise to find such a comprehensive survey of 
psychoanalysis, All shades of analytically-oriented 
theory are represented—Freud and the orthodox— 
the early deviants, Adler, Jung, and Rank—the 
neo-analysts, including Fromm, Horney, Sullivan, 
and others. The text proper, organized in terms of 
developmental stages, is a clear and unbiased state- 
ment of the analysts’ theories. All are represented 
fairly, and the author does not impose his preferen- 
ces. In his “notes,” which occupy a third of the vol- 
ume, Blum permits himself the luxury of criticism 
and opinion, and brings to bear much of the rele- 
vant evidence from research. He ably supports his 
thesis that psychoanalytic views provide the most 
promising present basis for a theory of personality, 
but that these views need to be sorted out, evaluated 
by research, and progressively refined. The book is 
a valuable reference for all interested in psycho- 
analysis—as who is not, these days—but especially 
for those disposed to approach it with a research 
orientation. —L. F. S. 
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Note: The reviews were prepared by the Editor 
and the Associate Editors, who may be identified 
by their initials. 
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Brower, Daniel, & Abt, Lawrence 
gress in clinical psychology. Vol. 
New York: Grune & Stratton, 1952. PP- 
+ 564. 2 vols. $5.75, $5.00. 


After a cogent introductory chapter by Abt, be 
rest of this forty-two chapter, two-volume a a 
contributed by 38 different authors, most of ae 
clinical psychologists. In the first volume the 3 as 
has been “to provide as complete a coverage 
possible for the past six years in clinical ps: li 
and to point up, in the process, as many stimu 
possible to further thinking and research. ature 
writing is somewhat uneven, but the Hean 
on the well-known intelligence and projectie wing 
is well, if not exhaustively, covered. The be ters 
section on psychotherapy includes separate CHAP ony 
on client-centered counseling, psychoanalytic tin 
and practice, play techniques, spontaneous “oñ 
therapy, and neurosis as a learning P enor pro- 
Volume 2 includes a section on developmen ions 
cesses from infancy to old age, one On apP, just? 
of clinical psychology to special areas, Gee ap” 
rehabilitation, crime, etc.), and a aroti ag cha 
proaches to clinical psychology which inclu S 
ters on psychosurgery, cultural anthropolo chnigue’ 
psychology, statistical methods, and $r 
The volumes conclude with a thoughtful 
of clinical psychology as a profession 
Raimy. The authors state their intentlor ar 
follow-up volumes, similarly designed, a 
or three years. This will necessarily pie 
the material surveyed yearly, but inerat i 
more briefly, by the Annual Reviews 


Jatt 
Human p jench 


g soia xxi 
$ 1953. 7%" 


Cabot, Hugh, & Kahl, Joseph A- 
concepts and cases in concre 
Cambridge: Harvard Univer. 
++ 333, viii + 273. 2 vols. $4 


Human Relations is the outgrowth n 
graduate course in social science tau : 
thors at Harvard. Volume I suppose’ A ae 
concepts to enrich the cases presen wit 
and to enable the student or teade 
cases, preferably, one gathers, phe 
instructor. If Volume I were = 
the Social Sciences,” rather tha 
tions,” it would be more ap 


New Books and Tests 


haps 90 per cent of the first volume consists of ex- 
tensive excerpts, frequently complete chapters, from 
the works of well-known sociologists, psychologists, 
Psychiatrists, philosophers, logicians, semanticists, 
and anthropologists. The authors usually supply 
brief introductions to these extensive quotations. 
The approach purports to be clinical, but it is any- 
thing but that. This volume is an excellent collection 
of first-rate writing in a variety of social science 
fields, but does not add up to a satisfactory treat- 
Ment of the subject of human relations. Volume ll 
Consists of 33 cases portraying a great variety of 
Situations in which “solutions” or “treatment pro- 
grams” are not offered. This makes them useful for 
class discussion. The treatment of the cases is “com- 
mon sense” rather than clinical. This is not said 
disparagingly since, to many, such an approach to 
human relations is preferred. It is questioned in this 
Publication only because the source material pre- 
sented in Volume I is largely from profound schol- 
ars and social scientists. The incongruity is striking, 
since the two volumes, which are intended to be 
used together, are practically unrelated.—M. K. 


Hamrin, S. A. Initiating and administering guid- 
ance services. Bloomington, Ill.: McKnight & Mc- 
Knight, 1953. Pp. xi + 220. $3.00. 


The author states that his object is to aid and 
Promote understanding and encouragement of guid- 
ance activities by school administrators. The topics 
discussed include the initiation of a program, in- 
Service education, and public relations. In addition, 
chapters are deyoted to descriptions of the tradi- 
tional services such as orientation, individual study, 
Counseling, occupational information, group activity, 
Placement, and follow-up. There are many excerpts 
from unprinted reports on existing programs by 
School practitioners. It contains little content of a 
Psychological nature. Although the author points 
out how few guidance workers have formal train- 
ing, there is not enough in the volume to indicate 
that the best guidance means more understanding 
of human motivation, frustration, and conflict reso- 
lution both in client and counselor. Such an empha- 
Sis seems, to the reviewer, appropriate even in a 
book emphasizing administration —F. McK. 


Hoyles, J. Arthur. The treatment of the young de- 
linquent. New York: Philosophical Library, 1952. 


Pp. xi + 274. $4.75. 


A British clergyman undertakes “a careful exam- 
ination of the lessons of history and the findings of 
Modern science in the light of Christian principles.” 
t leads him to the conclu ion that “there is an 
alternative to punishment.”—E. L. K. 


319 


Patterson, C. H. The Wechsler-Bellewue Scales: A 
guide for counselors. Springfield, Ill.: Charles C. 
Thomas, 1953. Pp. xiii + 146. $3.75. 


This monograph is a thorough and competent re- 
view of the research literature about the Wechsler- 
Bellevue, with a bibliography of 250 entries. The 
presentation is well organized, and each major sec- 
tion ends with an integrative summary of the con- 
clusions justified by the evidence. It is indeed a 
“guide for counselors” in the sense of displaying the 
values of the test and also its limitations.—L. F. S. 


Trenaman, Joseph. Out of step. New York: Philo- 
sophical Library, 1952. Pp. xx + 223. $4.75. 


A fascinating account of an attempt to rehabili- 
tate young but seriously delinquent soldiers, carried 
out by the British army during the war period. A 
sample of 200 cases was selected for intensive study 
and compared with nondelinquent soldiers of the 
same age with respect to a large number of physi- 
cal, psychological, and sociological variables. Al- 
though only one-third of the cases had a history of 
civilian offenses, the great majority appeared to 
have deep-seated problems likely to lead to conflict 
with either civilian or service authority. Most of 
the book is concerned with an analysis of the dif- 
ferences between delinquent and nondelinquent sol- 
diers, but it includes many details of the remedial- 
therapeutic program, of four- to six-months dura- 
tion, after which slightly over half of the cases made 
a satisfactory adjustment to army life—E. L. K. 


Weinland, James D., & Gross, Margaret V. Per- 
sonnel interviewing. New York: Ronald Press, 
1952, Pp. vii + 416. $6.00. 


A general text dealing with interviewing as 
practiced in business and industry, It is apparently 
intended for students with little or no previous 
training in psychology, since many of the chapters 
read like an elementary text in psychology. For 
example, one chapter is devoted to individual dif- 
ferences and another to a discussion of psychol- 
ogical tests. Other chapters, however, discuss almost 
every technique of interviewing, and specific types 
of interviews used in the industrial setting. The 
only bibliographical references are those included 
in an occasional footnote.—E. L. K. 


Tests 


Grassi, Joseph R. The Grassi Block Substitution 
Test for Measuring Organic Brain Pathology. 
Manual, pp. 75 ($3.00). Springfield, Ill.: Charles 
C Thomas, 1953. 


The Grassi Block Test is an ingenious modifi- 
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cation of the Kohs technique which involves two 
novelties, the use of three-dimensional reproduc- 
tion, and the Observation of ability to “shift” to a 
new color pattern. Each of five models, constructed 
from Kohs’s blocks, is presented as stimulus ma- 
terial for four progressive responses: (a) copying 
the top design, (b) copying the top design “with 
different colors,” (c) copying the three-dimensional 
design, and (d) copying the three-dimensional de- 
sign with a shift of colors. In view of the well- 
established findings that organic cases have diffi- 
culty with complex spatial perceptions, and also 
with ability to “shift,” this double-barreled testing 
method rests on a sound rationale. Both an objective 
scoring system and qualitative indications are used 
to interpret the test. The retest reliability is reported 
as .85, and validity data on 276 cases show a clear 
separation of organics from normals and undeteri- 
orated schizophrenics with little overlapping. Al- 
though the test needs further cross validation, it 
seems likely to become an interesting and efficient 
method for studying the psychological effects of 
brain pathology.—L. F. S. 


Kuhlmann, F., & Anderson, Rose G. Kuhlmann- 
Anderson Intelligence Tests. (6th Ed.) 9 levels, 
ages 5-adult. 1 form at each level. 20-30 (40-45) 
min. Test booklet, each level ($2.40 per 25), 
with key, directions, pp. 42, and handbook, pp. 
40; master manual, pp. 151 ($2.50); specimen 
set, 1 level ($1.00). Princeton, N. J. (188 Nassau 
St.) : Personnel Press, 1952. 


It is gratifying to see a useful psychological in- 
strument kept up to date by continued research. 
Although the test materials are basically the same 
as those first published in 1927, new analyses of 
reliability, discriminative power, and norms have 
been made in 1951. Among group tests, the Kuhl- 
mann-Anderson has always been distinguished by 
a clinical or “individual” flavor. It is not the easi- 
est of such instruments to administer and score, but 
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New Books and Tests 


qualified users have felt rewarded for their efforts. 
Either timed or untimed administration is possible, 
with reliabilities centering around .95. The manual 
provides recently verified norms, and extensive stä- 
tistical data including subtest intercorrelation® 
The new edition gives the impression that the se 
is by no means outdated, but is worthy of mor 
years of service.—L. F. S. 


Books Received 


Allen, Robert M. Introduction to the Rorschach 
technique. New York: International Universit! 
Press, 1953. Pp. 126. $3.00. iiiam 

Crawford, Claude C., Cooley, Ethel G., par 
ham, C. C., & Stoops, Emery. Living your nS 
Boston: Heath, 1953. Pp. xv + 448. $2.00 jie 

Devereux, George. (Ed.) Psychoanalysis a” as 
occult. New York: International Universiti 
Press, 1953, Pp. iv -- 220. $3.00. 

Field, Minna. Patients are people. New Yor 
lumbia Univer. Press, 1953. Pp. viii 
$3.75. ; 

Natenberg, Maurice. Freudian psycho-antics- 
cago: Regent House, 1953. Pp. 101. $2.00. 

Piaget, Jean. The origins of intelligence 1" 
dren. New York: International Universities 
1953. Pp. xi + 419. $6.00. ja 

Podolsky, Edward. (Ed.) Encyclopedia of aea, 
tions. New York: Philosophical Library, 

Pp. viii + 550. $10.00. r 

Reid, Joseph H., and Hagan, Helen R. Reside 


k: Co- 
244. 


Chi- 
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treatment of emotionally disturbed childre™ N 
York: Child Welfare League of America 
1952. Pp. ix + 313. $3.50. rk: 

Slavson, S. R. Child psychotherapy. New oo 
Columbia Univer. Press, 1952. Pp. xit 
$4.50. sement 

Tuckman, Jacob, and Lorge, Irving. Retiren 
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and the industrial worker. New York: Bury 
Publications, Teachers College, Columbia 
1953. Pp. xvi + 105. $2.75. 
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The concept of applicable continua for 
quantitatively describing the varying verbali- 
zations of the psychotherapist has previously 
been presented [3]. The purpose of this article 
is to describe some initial attempts to quanti- 
fy one of these continua, and to outline some 
of the applications that seem to be feasible 
from this approach. In the article referred to 
above two continua were selected for special 
attention from among those suggested. ‘These 
Were (a) the uncovering or interpretive con- 
tinuum and (4) the responsibility-balance con- 
tinuum. In the present paper attention will 
be given only to the first of these. 

With reference to the interpretive continu- 
um, it is noted that, among other things, the 
therapist’s verbalization is designed to aid the 
client in arriving at a clearer awareness than 
has existed before of some fecling, attitude, 
relationship, or aspect of his personality. Op- 
portunities for changes in meaning are assumed 
to be facilitated. Examination of verbatim 
transcriptions of psychotherapy interviews Te- 
veals variation, not only among therapists, but 
for the same therapist from one response to 
another, in the degree to which a therapist’s 
responses seem designed to facilitate an in- 
creased awareness of a relatively unrecognized 
aspect of a client’s tendencies. It is neither de- 
nied nor forgotten that therapists do other 
things as well. They “structure relationships” ; 
they indicate an “accepting,” “permissive,” 
“understanding” approach; at times, some may 
include “reassurance,” “advice,” and “suppor- 
tive’ therapy; they may also ask questions. 
Obviously, no particular school of therapy is 
here being emphasized. It is not the purpose 

1This article was completed after the writer ac- 


cepted a position as Chief Psychologist at the Jef- 
ferson Barracks Veterans Administration Hospital. 


of this series of studies to carry the aegis for 
any system to the exclusion of others. The 
initial problem of this study was to devise 
classificatory descriptions of a larger number 
of steps along the uncovering-interpretive con- 
tinuum than was done in the former article. 
In this earlier publication five steps were in- 
dicated. It remained to determine (a) if ad- 
ditional steps could be described, (b) if judges 
with experience in psychotherapy could reliably 
distinguish differences among these positions 
or along such a scale, and (c) to what extent 
would the original assumptions about relative 
scale positions be borne out by ratings of ex- 
perienced judges. 

The descriptive items that appear below to- 
gether with the accompanying instructions 
were submitted to 40 psychotherapists—ana- 
lytic psychiatrists and clinical psychologists. 
Twenty-six returned the material with com- 
pleted ratings. Several of the remaining 14 ex- 
plained that the approach seemed too different 
from their theoretical orientation to provide 
a basis for making the requested judgments. 
One thought this to be an attempt to stereo- 
type therapy and declined on that basis; an- 
other misunderstood the directions, assuming 
that the experimenter wished him to score him- 
self in retrospect as he had performed therapy. 
The wide variety of approaches to the thera- 
peutic relationship was inescapably evident 
from the letters of those who declined to par- 
ticipate. The variety of theoretical back- 
grounds for psychotherapy increases the diffi- 
culty of adequate communication. This prob- 
lem is illustrated by the critic who felt that 
the writer was attempting to stereotype psy- 
chotherapy, whereas one of the main interests 
behind this series of studies is to test the possi- 
bility of liberating psychotherapy from a stereo- 
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typet procedure. n 

The rating sheet was entitled “A Study in 
Discriminatien” and the task was introduced 
by the following instructions: 


You are being asked in this study to judge or 
rate types or kinds of responses which psychother- 
apists make in helping a patient work through his 
problems. It may be assumed for purposes of this 
study that therapists’ responses are designed, among 
other things, to aid the patient in developing in- 
sights, penetrating resistances, or uncovering hith- 
erto unrecognized aspects of the personality. The de- 
gree to which the therapist response is designed to 
penetrate typical resistances or uncover, etc. may 
vary from little or nothing to very much. Further- 
more, it must be emphasized that no implications 
are indicated in regard to what are appropriate or 
desirable therapist responses. Such judgments are 
made in terms of other criteria. Since this is a dif- 
ferent type of evaluation or judgment, your dis- 
criminations in terms of the present variable are to 
be made independently of theoretical convictions 
you may have about what a therapist should do. 

Below are descriptions of these types of responses. 
Ratings must, of course, be in terms of general im- 
plications, since it is recognized that the context of 
a specific therapy situation would introduce some 
variation, After reading a description of a type of 
therapy technique, indicate by encircling a numeri- 
cal position on the scale (1 to 11) the degree to 
which that kind of response seems in general de- 
signed to penetrate typical resistances, uncover or 
bring into clearer recognition an aspect of person- 
ality. Read all descriptions before rating any of 
them. Remember 1 = low degree of the variable 
described; 11 = high degree. 


The descriptive items are presented below. 
Except for item a, the scale which appeared 
after each item has been omitted. 


a. The therapist repeats the statement the patient 
has just made. 
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b. The therapist suggests a relationship between 
what the patient has just said and what he said at 
an earlier time. 


c. The therapist responds by a nonverbal vocali- 
zation, e.g., “M-hm.” 


d. The therapist abstracts common dynamic ele- 
ments or trends from repetitive occurrences of pat- 
terns of feelings, thoughts, and action when such 
patterns are dominated by a dissociated, rejected, 
or repressed experience or trend and brings this re- 
lationship to the recognition of the patient by any 
of a variety of interpretive procedures. 


e. The therapist selects a portion of the patient’s 
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response and repeats it. 
f. The therapist remains silent. 


g. The therapist condenses or epitomizes what the 
patient has just said in terms of what seems to bo 
the essential immediate meaning of the patients 
response. 


h. The therapist suggests a relationship epee 
current attitudes and reactions of patient and a 
experiences or tendencies when such relationship? 
have thus far gone unrecognized or only symboli 
cally represented. 


i. The therapist suggests a relationship het 
a current patient response and some early eperen 
or tendency when such relationship has already 
been vaguely recognized by the patient. ’ 

į. The therapist phrases his response so 38 bi a 
dicate a recognition of the feeling oF emotio 
aspect of what the patient has just said. p 
so as to 1M7 


i S i sponse 
k. The therapist phrases his respor hat the Pa 


dicate a recognition of the content of w 
tient has just said. 


Results and Interpretation 


The data collected in the manner described 
above were treated according to Tae 
method (10) for attitude-scale building., Il 
centile points were determined graphica 3 
Table 1 shows the results, based on an 
26. The entries of the table are arrang 


descending order of the Q, values. 


ed in 


Table 1 nants 


Initial Scale Values of the Uncovering Cont! = 


Descriptive Quartile Points Q2: 
Items Q, Q; Qs ; 


1.2 
d 94 10.3 10.6 19 
h 78 9.1 9.7 1.6 
i 74 8.2 9.0 2.8 
b 4.8 6.5 7.6 2.0 
j 4.5 5.5 e 3.2 
z 3.4 5.4 s 2.1 
e 2.0 3.5 4.7 1.9 
k 1.8 2.7 sí 2.2 
a 0.6 1.5 2.8 1.5 
ë 0.6 1.4 2.1 aA 


a that the 3 
From Table 1 it 1s appare’, responses re 


. ‘ s7 
scriptive categories of therapist The scale ar 
resent discriminable diferent ae ne a 

ne item to hat t 
tances from one 1f it expect tat h 


i as 
are not uniform, nor W: ible 
would be. It is theoretically poss!?™ 
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to construct sufficient additional descriptive 
categories so that a later more ambitious scaling 
attempt could provide a residuum of items 
which would represent a more uniform se- 
quence of steps from one scale extreme to the 
other. Items used here tend to represent about 
five regions or levels according to their tenden- 
cy to cluster. Since the average semi-inter- 
quartile range is 1.05, it is assumed somewhat 
arbitrarily that scale distances greater than 1 
between items begin to represent reliable differ- 
ences. Thus, near the zero end there are three 
items within a range of 1.1; these are f, ¢ and 
a. Silence, m-hm, and repetition appear at 
scale positions of 0.7, 1.4, and 1.5, respectively. 
It may be a mistake to put silence in this group 
for theoretical reasons and it does seem to be 
somewhat by itself. Clearly, however, m-hm 
and repetition are scaled in very close prox- 
imity. The second level is represented by k 
and e, wherein simple recognition of content 
and repetition of a selected portion of the pa- 
tient’s response seem more similar to each other 
than to items on either side. 

In the midpart of the scale three items occur 
within the range of 1.1, while the cluster 1s 
separated on either side by nearly 2 scale 
points. These items, g, j, and b, are categories 
of therapists’ responses which seem obviously 
designed to provide more aid in the reassoci- 
ative process than those preceding. That the 
scaled apparent intent of the therapist corre- 
sponds with the implied result, i.e., that the 
reassociative process is facilitated, is a hypothe- 
sis which remains to be tested. However, it 
would seem more penetrating or revealing, 
for example, to recognize feeling (j = 5.5) 
than simply to recognize content (4 = ZIS 
or, to suggest a relationship between current 
and previous patient verbalization (6 = 6.5) 
would seem more revealing than simply to 
repeat a portion of a patient’s response (e = 
335) 

The writer recognizes, of course, that 
specific therapy situations under which these 
categories of responses occur can cause con- 
siderable variation in a therapist’s intent and 
in the associative facilitation for the patient. 
Because of this, one may be somewhat surprised 
that the Q measure of reliability does not in- 
dicate more variability than it does. 


The fourth level is represented by i anc“h at 
8.2 and 9.1, respectively. Both of these items 
describe therapists’ responses as suggesting re- 
lationships. This also occurred for b at 6.5; 
but at 8.2 and 9.1 the relationship dealt with 
has gone beyond two temporally separated pa- 
tient responses and involves relationships either 
only vaguely recognized or symbolically repre- 
sented by the patient. Again, it would seem 
obvious that the therapist is using a more 
penetrating technique than at levels scaled at 
lower values. 

The fifth level is represented in this study 
by d, scaled at 10.3. Here the therapist is 
again suggesting relationships, but now it is 
on a broader basis. He attempts to help his 
patient see common dynamic elements running 
through a variety of experiences and activities 
when these elements have tended to elude the 
patient because of dissociative emotional re- 
sistances. Perhaps it should be said again that 
the purpose of this paper is concerned neither 
with the “whether” nor the “when” problems 
of appropriateness of these categories of thera- 
pist activity. Some therapists would be ap- 
palled by the idea of their ever using a response 
scaled higher than the one at 5.5. Others do 
not hesitate to use a variety of responses rang- 
ing over the whole scale. Only extensive evalu- 
ative studies can eventually provide the an- 
swers of “if” and “when” these categories are 
appropriate. 

Pilot-study applications of this scale have 
been made to such material as found in Sny- 
der’s Casebook [9], Axline, Play Therapy 
[1], Rogers’ case of Herbert Bryan in Coun- 
seling and Psychotherapy [7], Berg’s Deep 
Analysis [2], Deutsch’s 4 pplied Psychoanalysis 
[4], and Eidelberg’s Take Off Your Mash 
[5]. In the Axline material the writer has 
found nothing to rate beyond a scale value of 
four; in Snyder and Rogers the upper scale 
value limit is six. The therapist responses in 
Berg, Eidelberg, and Deutsch seem to ran e 
over the whole scale. On well-known i 
retical grounds, the “nondirective” group a 
poses limitations on themselves which the 
analysts do not. In terms of therapy 

F : goals 
€g., quality and rates of improvement, it ee 
mains to be determined what limits i 
propriate for age, sex, 
of therapy, etc. 


are ap- 
type of problem, stage 


324 Rex M. 

In general, the hypothesis presented in the 
earlier publication [3] that there were dis- 
criminable differences along an uncovering or 
revelatory interpretive continuum has had in- 
itial confirmation. Furthermore, the steps along 
the scale as described at that time have oc- 
cupied the sequence anticipated. However, the 
progressive increase in scale distance through 
the originally described five steps has not been 
confirmed in this study. In part this may be 
due to the accidents of illustrative selections, 
but it is apparently more assignable to larger 
discernible differences among the categories of 
responses at the lower end of the continuum 
than were hypothetically anticipated. Thus, 
there may be, for example, a greater scalable 
difference between repeating the client’s state- 
ment and repeating a selected portion of the 
client’s response than was originally assumed. 
Certainly one finds an analyst like Deutsch 
[4] using the technique of repeating a selected 
portion of a patient’s response in a very pene- 
trating manner. 


In a second part of this study, 50 examples 
of verbal exchanges were submitted for rating 
to staff members and advanced graduate stu- 
dents who had had experience and training in 
psychotherapy. An eleven-point scale and simi- 
lar instructions were used. Included in these 
selections were the examples in the initial 
article [3]. These selections were included in 
order to test the following hypotheses: (a) 
that these examples represent a sequence of dis- 
criminable differences along this continuum, 
(&) that the scale differences become progress- 
ively greater from one example to the next. 
The examples were as follows: 


a. Pt. I hate my father, I hate my brother! 
Th. You hate your father, you hate your broth- 
er. 

b. Pt. PII be ten years old. I’m in the fourth 
grade. My dad wants me to be in the fifth grade, 
but I tell him I don’t want to be in the fifth grade. 
I like to fail. 

Th. You like to fail. 


c. Pt. The only thing is that I can’t help but feel 
that I work against myself. I mean it’s just so 
obvious to me: that I do work against myself, And 
it seems rather silly to be one minute trying to do 
something about it, and then it seems so certain that 
there’s something present that doesn’t want to do 
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anything about it. (Pause) It’s such a contrary thing 
—the whole problem is just— 

Th. So that the very time that one part of you 
is perhaps really taking hold of this whole situa- 
tion, another part of you is just sabotaging the 
whole business. 


d. Th. Do you remember that you had the same 
feeling in connection with mother, for whose health 
you were concerned, and that you behaved as if you 
were she? Do you remember that I reminded you 
of a statement of little Ralph who once said, “If I 
don’t stop behaving so badly, it will kill her.” Do 
you remember you said it? 

Pt. That's right. 

Th. And that you had to run home to see 
whether she were still alive and that you had a 
bad conscience as if you had done something 
wrong? Then you said something wrong means: 
Something is wrong with your heart or you di 
something wrong. Now, you said when your girl 
friend complained about her heart, you felt as 1 
you were she. 


e. Pt. He started to undress me and I embraced 
him, Suddenly, the image of my aunt appeared, a 
again I heard her warning. I grew frightened an 
ran away from Carl. 

Th. What happened to the sexual excitement? 

Pt. It disappeared as soon as I remembered my 
aunt’s warning and grew frightened. 

Th. Without this anxiety, you probably would 
not have heeded your aunt's warning, and You 
probably would have had sexual intercourse with 
Carl. From this point of view, the anxiety WaS i 


valuable help, because your sexual desire had a 
stroyed your ability to resist your cousin. If a 
yi 


aunt’s warning had appeared without anxiety, aa 
would not have had the power to interrupt ee 
sexual play and to escape unharmed. That was er- 
situation at the time. Today, however, sexual ol 
course is no longer a danger. Now you may att 
ceive a child without being blamed for it. BUE 


still behave as if you were a little girl. Why? 


The scale values of these examples are given 
in Table 2, based on an N of 24. 


Table 2 


A ses 
Scaled Examples of Psychotherapists’ Respons 


Quartile Points 


Q» fs 


Examples 
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These data confirm the first hypothesis 
which stated that these verbal exchanges would 
represent discriminable differences along the 
continuum as described. The results with 
specific examples are similar to the results ob- 
tained when types of exchanges are rated. The 
finding implies that this kind of judgment can 
be made with a measurable degree of reliability, 
and that judges tend to perceive these differ- 
ences in a similar way. The second hypothesis, 
which stated that there would tend to be 
Progressive increases in scale distance from 
one example to the next, is only partly con- 
firmed. The sequence of scale differences is as 
follows: b~a=0.3:c-b=3.2;d-c=34; 
and e — d = 0.5. The first three differences 
become progressively larger, but the suggested 
Pattern breaks down at e — d. These differ- 
ences are, of course, in part, a function both 
of the method used and the examples selected. 
A Paired-comparison method would yield some- 
what different results. A longer scale might 
also make a difference, since some judges tend 
to be conservative in their use of extreme 
ends of a rating scale. Both the b-a and the e-d 
distances suggest this well known tendency of 
Conservative raters to regress their ratings away 
from the extremes. That the selection of ex- 
amples is important, also, is indicated by the 
fact that some in this set of 50 were consist- 
ently rated higher than the one used to illus- 
trate the upper extreme in 1950. Such an 
example follows: 


Pt. My other dream seems to make no sense at all. 
I wanted my boy friend to kiss me and yet I felt 
I shouldn't hesitate to kiss him if I want to. Then 
as I started to kiss him, my nose got in the way; it 
seemed longer than usual, sort of like it had Pinoc- 
chio qualities. Jack noticed it right away. He 
seemed disappointed. 

Th. How did you feel? 

Pt. I believe I felt both surprise and somewhat 
elated. 

Th. Elated even though your boy friend was 
disappointed. 

Pt. That’s what doesn’t make sense. I don’t want 
to lose him, but I seem to remember feeling that 
now I’m as good as he is. 

Th. Do you remember telling me that your father 
Probably would have been happier if you had been 
a boy and that as you grew up you often competed 
with boys in boys’ games? Now, it seems you would 
still like to compete; this time it’s with your boy 


325 


friend in playing the masculine role. You would 
not only like to be the aggressor but would also like 
to have a masculine genital organ. 


The Q, value of this example is 10.2 with 
Q: and Q, at 10.6 and 9.1 respectively. The 
interquartile difference of 1.5 indicates little 
disagreement in the scale location of this item. 


Applications of the Scale 

Among the anticipated applications of a scale 
of this kind the following few are suggested : 

1. Assuming that reliable criteria of patient 
improvement can be identified, we may relate 
the indices of improvement to scale levels used 
by the therapist. 

2. Rogers and some of his students have 
insisted that insight occurs most frequently fol- 
lowing simple acceptance by the therapist of 
what the client has said. Assuming that in- 
sightful responses may be identified and rated, 
we can relate the frequency of insight of vary- 
ing degrees of comprehension to the scale level 
represented by the therapist’s responses. Ac- 
cording to Rogers’ approach, we should expect 
the higher scale values of therapists’ responses 
to be followed (a) by a reduced frequency of 
insight and (b) by an increased frequency of 
rejection by the client of these therapist re- 
sponses. The writer’s experience is such as to 
cast strong doubt on these theoretical posi- 
tions. 

3. Assuming that dependency and transfer- 
ence tendencies can be reliably identified in 
transcripts, we can relate these tendencies to 
scale value levels represented by the therapist. 
The nondirective school [8] would perhaps 
hypothesize that the more frequently the upper 
levels of the scale were used the greater would 
be the tendency for a dependency relationship 
on the therapist to develop. 

4. Should therapy with psychotics and pre- 
pE ne m E d non interpretive ? 

R 5 S) erapy is in serious 
(ears fhe acter to shit goto 
£ le approach such as the 
one above, the question might be revised as 
follows : How interpretive should the thera- 
pist be in order to effect maximum improve- 
Pace eee a A 
ao ge, sex, type of diagnosis, and 
duration of disturbance would have to be con- 
trolled in such an approach, 
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5.*Fiedler’s result [6] that experienced 
therapists are more alike regardless of school 
than are therapist and student within a school 
could be re-examined by this scaling approach. 
The writer’s anticipation is that results from 
applying the interpretive continuum would not 
agree with Fiedler. 

6. There are also applications in the train- 
ing of students. One of these, certainly, is that 
this approach provides an integrative rationale 
which enables the student to feel secure with 
a more uncovering or interpretive approach to 
his patient under certain circumstances than 
if he is “all” analytic or “all” nondirective. 
Another application lies in the direction of 
testing the sensitivity of the student. Stu- 
dents’ ratings of therapists’ responses in ex- 
amples of patient-therapist verbal interchanges 
seem to reveal varying degrees of student sensi- 
tivity to the implications of the interchange. 
Such ratings related to relative success in 
clinical courses, e.g., psychotherapy, might 
yield useful predictive results. 


Summary 


The continuum concept previously devel- 
oped for quantitative application to the re- 
sponses of the psychotherapist has been ex- 
tended and initially applied. Types of therapist 
responses have been identified and scaled ac- 
cording to the Thurstone method of attitude- 
scale building. Reliability scores of scale posi- 
tions indicate that judges with experience in 
psychotherapy tend to perceive the descriptive- 
scale items with a fair degree of consistency. 
The continuum concept developed previously 
for psychotherapy material has had initial sub- 
stantiation. The hypothetical scale positions in- 
dicated in the previous article have been initial- 
ly verified with minor exceptions. A variety of 
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applications of this type of scale have been sug- 
gested for testing hypotheses concerning (a) 
relationships between patient improvement and 
quantitative variations of therapist activity, 
(b) relationships between type and frequency 
of insight and scale positions representing 
therapist responses, (c) relationships between 
content indications of transference and scale 
ratings of therapist responses, (d) relation- 
ships between scale ratings of therapists’ re- 
sponses and effective work with psychotics. 

These are a few examples suggested only to 
illustrate what seem to be potentially fruitfu 
applications of this continuum approach to 
some of our problems in psychotherapy. 


Received January 5, 1953. 
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This paper reports the development and 
cross-validation of a scale which was originally 
designed to predict the response of psycho- 
neurotic patients to psychotherapy. Considera- 
tion of the scale content and its correlates, 
however, suggests that a somewhat broader 
Psychological interpretation be placed upon it, 
making it useful as an assessment device in any 
situation where some estimate of adaptability 
and personal resourcefulness is wanted. It ap- 
pears to measure the various aspects of effective 
personal functioning which are usually sub- 
sumed under the term “ego-strength.” 

The scale consists of 68 items from the Min- 
nesota Multiphasic Personality Inventory, Se- 
lected from a total MMPI pool of 550 items 
on the basis of significant correlation with 
rated improvement in 33 psychoneurotic pa- 
tients who had been treated for six months in 
a psychiatric clinic. The test responses of the 
patients were obtained before psychotherapy 
began, so that the scale, so far as logic of con- 
struction is concerned, is designed to predict 
whether or not after about six months of 
therapy the patient will have improved. 

The sample of 33 patients was divided into 
two groups: 17 patients who were judged to 
have clearly improved, and 16 patients who 
were judged to be unimproved. Although the 
sample is small, the cases were intensively stud- 
ied, and two skilled judges who had thor- 
oughly acquainted themselves with the course 
of the therapy (although not themselves in- 


1This study was carried out for the most part at 
the Institute of Personality Assessment and Re- 
search, and was supported financially by a grant of 
the Rockefeller Foundation to that institute. Drs. 
Robert E. Harris and Timothy Leary supplied data 
for two of the cross-validating samples. 


327 


California 


volved in it otherwise) were in considerable 
agreement (r of .91) in their independent rat- 
ings of degree of improvement. While one 
would not ordinarily base scale development 
on a sample of this size, it was reasoned here 
that a small number of well-studied cases who 
were classified with high reliability, and, as 
collateral evidence indicated [2], with high 
accuracy as well, would serve better than the 
practical alternative, which was to get a large 
sample in which the therapist’s rating of out- 
come was accepted uncritically. 

When the Improved and Unimproved 
groups were scored on this 68-item scale, the 
mean of the Improved group proved to be 
52.7, that of the Unimproved group 29.1, a 
difference which is significant well beyond the 
.01 level (¢ of 10.3). The odd-even reliability 
of the scale in a clinic population of 126 pa- 
tients is .76. Test-retest reliability after three 
months in a sample of 30 cases is .72. 

The 68 items of the scale are presented be- 
low, arranged in groups according to the kinds 
of psychological homogeneities which, in the 
judgment of the writer, are involved in the 
item content.? 


1. Physical functioning and physiological stabil 
ity, M155. During the past few years I have bi i 
well most of the time (T).°51. I am in j eal 
good physical health as most of my friends (T). 


2 The improved direction is gi i 
parentheses after each item. Meter ee i 
tak:n from the booklet form of the MMPI To sa rs 
printing costs, a table giving the mercentaren i 
improved and unimproved patients answenine ch 
item ‘true” has been deposited with the co iea 
Documentation Institute. Order Document No "2085 
from ADI Auxiliary Publications, Photoduplicati : 
Service, c/o. Library of Congress, Washington oe 
D.C., remitting in advance $1.25 for 35-m A 
crofilm or $1.25 for 6 by 8-in. photocopies. eo 
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174. Ss have never had a fainting spell (T). 189. I 
feel weak all over much of the time (F). 187. My 
hands have not become clumsy or awkward (T). 
34. I have a cough most of the time (F). 2. I have 
a good appetite (T). 14. I have diarrhea once a 
month or more (F). 341. At times I hear so well 
it bothers me (F). 36. I seldom worry about my 
health (T). 


2. Psychasthenia and seclusiveness. 384. I feel 
unable to tell anyone all about myself (F). 489. I 
feel sympathetic towards people who tend to hang 
on to their griefs and troubles (F). 236. I brood a 
great deal (F). 2f7. I frequently find myself wor- 
rying about something (F). 160. I have met prob- 
lems so full of possibilities that I have been unable 
to make up my mind about them (F). 234. I get 
mad easily and then get over it soon (T). 270. 
When I leave home, I do not worry about whether 
the door is locked and the windows closed (T). 
359. Sometimes some unimportant thought will run 
thfough my mind and bother me for days (F). 
344. Often I cross the street in order not to meet 
someone I see (F). 241. I dream frequently about 
things that are best kept to myself (F). 

3. Altitudes towards religion. 95. I go to church 
almost every week (T). 488. I pray several times 
every week (F). 483. Christ performed miracles 
such as changing water into wine. (F). 58. Every- 
thing is turning out just like the prophets of the 
Bible said it would (F). 420. I have had some 
very unusual religious experiences (F). 209. I be- 
lieve my sins are unpardonable (F). 

4. Moral posture. 410. I would certainly enjoy 
beating a crook at his own game (T). 181. When 
I get bored, I like to stir up some excitement (T). 
94, I do many things which I regret afterwards (I 
regret things more or more often than others seem 
to) (F). 253. I can be friendly with people who do 
things which I consider wrong (T). 109. Some 
people are so bossy that I feel like doing the oppo- 
site of what they request, even though I know they 
are right (T). 208. I like to flirt (T). 430. I am 
attracted by members of the opposite sex (T). 
548. I never attend a sexy show if I can avoid it 
(F). 231. I like to talk about sex (T). 378. I do 
not like to see women smoke (F). 355. Sometimes 
I enjoy hurting persons I love (T). 

5. Sense of reality. 33. I have had very peculiar 
and strange experiences (F). 349. I have strange 
and peculiar thoughts (F). 251. I have had blank 
in which my activities were interrupted and 
not know what was going on around me (F). 
I am with people, I am bothered by hear- 
queer things (F).* 22. At times I have fits 
id crying that I cannot control (F). 
d no difficulty in keeping my balance 
62. Parts of my body often have 
tingling, crawling, or like 
My skin seems to be un- 


spells 
I did 
48. When 
ing very 
of laughing a! 
192, I have ha 
in walking Le = 
feelings like burning, 
he to sleep”. 541. 
usually sensitive to touch (F). 
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6. Personal adequacy, ability to cope. My plans 
have frequently seemed so full of difficulties that 
I have had to give them up (F). 82. I am easily 
downed in an argument (F). 32. I find it hard to 
keep my mind on a task or job (F). 24. My way 
of doing things is apt to be misunderstood by others 
(F). 5%5. I sometimes feel that I am about to g0 to 
pieces (F). .5-et. I feel tired a good deal of the 
time (F). 261. If I were an artist, I would like to 
draw flowers (F). 554. If I were an artist, 
would like to draw children (F). 132. I like col- 
lecting flowers or growing house plants (F). 140, I 
like to cook (F). 380. When someone says silly oF 
ignorant things about something I know, I ty ie 
set him right (T). 

7. Phobias, infantile anxieties. 367: I am not a- 
fraid of fire (T). 525. I am made nervous by gare 
tain animals (F). 510, Dirt frightens or disgusts 
me (F). 494. I am afraid of finding myself in 4 
closet or small closed place (F). 559. I have often 
been frightened in the middle of the night (F). I 

8. Miscellaneous. 221. I like science (T). 543- 
think Lincoln was greater than Washington oh 
561. I very much like horseback riding (F). oe 
The man who had most to do with me when I was 
a child (such as my father, stepfather, etc.) wide 
very strict with me (T). 421. One or more mem 
bers of my family is very nervous (T). 


The pretherapy characteristics of patient 
who improve in therapy, as compared wit 
those who do not improve, might be summar” 
ized as follows: , 

Improved: (a) good physical functioning 
(b) spontaneity, ability to share emotiona™ " 
periences; (c) conventional church member" 
ship, but nonfundamentalist and undone 
in religious beliefs; (d) permissive mora ' yi 
(e) good contact with reality; (f) feelings i 
personal adequacy and vitality; (g) physi 
courage and lack of fear. 


, 


sive and punitive morality ; 
and ego-alienation; (f) confusion, SU? tile 
ness, chronic fatigue; (g) phobias an 
anxieties. one 

From an inspection of these differen itl 
might easily be led to envy the mental Si out t° 
of psychoneurotic patients who are a how- 
improve. Their actual mental dah pre 
ever, has been detailed in cas¢ mi, an 

; 


sented in two previous reports 
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will not be repeated here. What the group 
comparison really reveals, of course, is the 
dimension on which the improved and un- 
improved groups differed. Had the improved 
patients been compared with an exceptionally 
healthy nonclinic group of subjects, the same 
items might well have emerged as descriptive 
of the difference between the groups, but with 
the characteristic responses of the improved pa- 
tients being exactly opposite to those listed 
above. In other words, the nature of the cri- 
terion behavior determines the nature of the 
dimension which the item analysis will reveal, 
but the question of the strength of that vari- 
able in the criterion groups must be answered 
separately. 

_ In this case, it is suggested that what is be- 
ing measured is a general factor of capacity 
for personality integration, or ego-strength. 
The greater vividness of psychopathology often 
tends to obscure the ego-synthetic or construc- 
tive forces in the behavior of a psychologically 
disturbed individual, so that a prognostic 
evalution is generally more difficult to make 
than a diagnostic evaluation. Nevertheless, 1n 
spite of the saliency of psychopathology in the 
flinical picture, it may be presumed that the 
patient has certain latent strengths which will 
gradually show themselves, particularly as the 
psychological crisis which brings him to ther- 
apy subsides. What the item content of the 
prediction scale seems to indicate is that these 
strengths are of the sort that are generally 
ascribed to a well-functioning ego, and that it 
is latent ego-strength which is the most im- 
portant determinant (within the patient) of 
response to brief psychotherapy. 

Such an interpretation would, of course, 
have relatively little warrant without support- 
ing evidence from other samples. The obvious 
next step is to inquire into the relation of the 
scale to other measures in new populations. 


Correlates of the Prediction Scale 


In this further inquiry, one clinic sample 
and two nonclinic samples were studied. The 
clinic sample consisted of 77 women and 50 
men who were seen for diagnostic studies on 
the Psychology Service at Langley Porter 
Clinic during a given term of work. The non- 
clinic samples consisted of 160 male Air Force 
officers and 40 male graduate students. 


The first step was to obtain adjective de- 
scriptions, by objective and skilled observers, 
of high and low scorers on the prediction scale. 
This was made possible by administering the 
MMPI to graduate students who were partic- 
ipating in intensive three-day psychological 
assessments being conducted at the Institute of 
Personality Assessment and Research, Univer- 
sity of California, Berkeley. Following the 
assessment periods, the staff members of the 
Institute filled out an adjective checklist with 
the purpose of describing each one of the sub- 
jects in the assessment, on the basis of the 
subject’s socially observable behavior in situa- 
tional procedures, interviews, and, informal 
social interaction. A composite staff impression 
was thus assembled. The 10 highest and 10 
lowest scorers on the psychotherapy prediction 
scale were then compared by item-analyzing 
the composite adjective list for the two groups. 
The adjectives which showed a statistically sig- 
nificant difference (.05 level) between high 
and low scorers are listed below. (The staff 
observers were, of course, in ignorance of the 
test scores of the subjects.) 


a. Adjectives checked more frequently about 
high-scoring subjects: alert, adventurous, deter- 
mined, independent, initiative, outspoken, persistent, 
reliable, resourceful, responsible. 

b. Adjectives checked more frequently about low- 
scoring subjects: affected, dependent, effeminate, 
mannerly, mild. i 


‘The general impression conveyed is of great- 
er resourcefulness, vitality, and self:direction 
in the high scorers, and effeminacy, inhibition, 
and affectation in the low scorers. This picture 
is supported by staff ratings of these same sub- 
jects on a number of psychological variables 
which it was thought could be inferred from 
social behavior in the assessment setting. The 
psychotherapy prediction scale correlated sig- 
nificantly with Vitality (.38), which was defined 
simply as “general energy level,” and with 
Drive (.41), defined as “persistence, resolu- 
tion, perseverance, directed energy.” In addi- 
tion, the scale showed low but positive cor- 
relation with several other variables descrip- 
tive of effective functioning. These are: Self- 
confidence (.24), Poise (.24), and Breadth of 
Interest- (.25). Significant negative correla- 
tions are with Submissiveness (—.40), Effem- 
inacy (—.34), and Intraceptiveness (~.34) 
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As is the adjective descriptions, the high scor- 
ers on the scale emerge as more adequate phys- 
ically, more sat ease socially, and ‘somewhat 
broader culturally. Low-scoring men are efiem- 
inate, submissive, and inclined to turn inwards 
rather than to be emotionally outgoing. 

The relationship of the prediction scale to 
intelligence was next investigated. Among the 
functions of the ego, as described by psycho- 
analytic writers and summarized by Fenichel 
[4], are perceiving, planning, synthesizing, 
and, in general, bringing the subject into an 
adaptive relationship to reality. Ego-deter- 
mined behavior is what we are accustomed to 
calling intelligent behavior. Any scale which 
purports to measure ego-strength should be 
positively correlated with standardized meas- 
ures of intelligence. 

In the sample on which the scale was de- 
veloped, its correlation with Wechsler-Belle- 
vue IQ is .44. In the Air Force officer sample, 
the scale correlates .36 with total score on the 
Primary Mental Abilities test, and .47 with 
the Intellectual Efficiency scale of the Cali- 
fornia Psychological Inventory. In that same 
sample it correlates .48 with the Potential Suc- 
cess scale developed at the Institute of Person- 
ality Assessment and Research against a cri- 
terion consisting of faculty ratings of the prob- 
able professional success of the doctoral candi- 
dates studied. In the graduate student sample 
itself, the psychotherapy prediction scale cor- 
relates .39 with intelligence as measured by the 
Miller Analogies Test. Further, in the latter 
sample it correlates .52 with the Intellectual 
Efficiency scale. Thus it relates to general in- 
telligence, as measured by a variety of tests, 
even in highly restricted ranges of intelligence. 
Certainly the ego-strength interpretation of 
the scale is supported. 

The scale also is related to tolerance and 
lack of ethnic prejudice. In the standardization 
sample it correlates —.47 with the Ethno- 
centrism (E) scale of Form 60 of the Univer- 

sity of California Public Opinion Study Ques- 
tionnaire. In the graduate student sample it 
correlates —.35 with the Prejudice scale [5] 
of the MMPI, and —.46 with the Æ scale, 
Its correlatior with the £ scale in the Air 
Force officer sample is —.23, and its correlation 
with the Tolerance scale of the CPI in that 


sample is 42. 
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Again, these findings lend some weight to 
the notion that what is being measured is gen- 
eral excellence of ego-functioning. The authors 
of The Authoritarian Personality [1], in their 
successful search for the character defects 
which accompany ethnocentrism, found that 
high scorers on the Æ scale show “lack of dif- 
ferentiation of the ego.” This is manifeste 
among clinic patients [7], in “a narrow range 
of experience, emotionally and intellectually, , 
together with “rigidity and constriction, 
“stereotyped thinking,” and so on. All of these 
things are thus, by inference, negatively relate 
to scores on the psychotherapy prediction scale. 

The relationship of the scale to the diag- 
nostic and validity scales of the MMPI was 
determined in both the graduate student sam” 
ple and the diagnostic study cases. The results 
are shown in Table 1. Surprisingly high nega” 
tive correlations are found with most of the 
measures of psychopathology, averaging 1" pee 
neighborhood of —.60 with Hypochondrias!® 
Depression, Hysteria, Psychasthenia, and Schi- 
zophrenia, and around —,50 with Parano! i 
the clinical samples. What this suggests !$ tna: 
the prediction scale is picking up a genera fac 
tor of psychopathology in the MMPI, reflect- 
ing degree of maladjustment or ego-dysfune” 
tion irrespective of differential diagnos’: . g 
other words, it is related to general elevatio 
of the profile, regardless of the pattern- 


Table 1 
Relationship of Ego-strength Scale to Diagn 
and Validity Scales of the MMPI 
in Clinic and Student Populations 


ostic¢ 


ale 
A. Male B. Male C Fag 
Clinic Graduate CIP a 
Patients Students Pavel) 
Scale (N=50) (N=36) — 
F —.49 m 
s si -63 
Hs —.62 abi 
D —.60 63 
Hy -.39 34 


5 urse, P 
The correlations are, of COUT 4 


: . ner: 
function of overlap of items (gener 
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in the reverse direction) between the predic- 
tion scale and the diagnostic scales. The 
amount of net overlap for each scale is shown 
in Table 2. The very fact of overlap itself 
testifies to the character of the scale as a meas- 
ure of general excellence of ego-functioning, 
manifested in this instance by absence of chron- 
ic psychopathology. 


Table 2 


Item Overlap of Ego-strength Scale 
and MMPI Diagnostic Scales 


3 Y 
E 53 £ 
ögg Hes Ë 

P aiB 283 Š 

ri ENS £09 2 

8 gA pee 3 

a ASA SSA z 

Hs None’ 2;43, 51, 62, Seven items, 


scored opposite 
Eight items, 
scored opposite 


453, 189, 192 
D 58, 241 2, 32, 36, 43, 51, 153, 
189, 208, 236, 270 


Hy 253 -2 32, 43, 51, 109, 153, Nine items; | 
174, 189,192, 234 scored opposite 
Pd 82 32, 33, 94, 231,244 Four items, 
scored opposite 
Pa None 109, 341° Two items, — 
scored opposite 
Pt None 22, 32, 36, 94,189, Nine items, _ 
217, 344, 349, 359 scored opposite 
Sc None 22, 187, 192, 241, Six items, | 
251, 349 scored opposite 
Ma 109, 181 22, 100, 251 One item, 


scored opposite 


‘The scale has not yet been put in a T-score 
form which would be comparable to the profile 
scores of other MMPI scales. This is princi- 
pally because no representative sample of nor- 
mal records has been available to the writer. 
The raw score means and standard deviations 
of the samples studied are presented in Table 
3, however. The values are fairly consistent in 
the clinical samples, with somewhat higher 
means for the graduate students and Air Force 
officers. 

It would be justifiable, of course, to deter- 
mine T scores on the basis of the clinic samples 
alone, provided that the scale is to be inter- 
preted solely as a Psychotherapy Prognosis 
scale for use in an outpatient clinic. In Table 4, 
a chart is given for conversion of raw 
scores into T scores when the scale is used 


only for such prediction purposes rather than 
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as a measure of ego-strength in the géneral 
population. 


Table 3 
Ego-strength Scale Statistics 
Sample N Range Mean SD 

1. Standardization sample 33 15-62 41.94 13.30 
2. 1st cross-validation 

sample* 53 26-58 40.10 7.62 
3. 2nd cross-validation 

sample 52 23—60 41.04 8.18 
4. 3rd cross-validation 

sample 46 22-61 42.06 9.32 
5. Clinic diagnostic cases 127 23-60 41.97 7.36 
6. VA mental hygiene eaa 

clinic patients æ 52 22-59 41.79 7.38 
7. L.P.A.R. graduate 

students 40 37-60 50.92 5.62 
g. Air Force officers 160 38-60 52.73 4.05 


* Scores on abbreviated scale prorated for length of 
scale. 


Table 4 


Conversion Table for Use of Ego-strength Scale 
in Clinic Samples 


Raw Score T Score Raw Score T Score 
22 25 46 57 
23 27 47 58 
24 29 48 59 
25 30 49 60 
26 32 50 62 
27 33 51 63 
28 34 52 64 
29 36 53 65 
30 37 54 67 
31 38 55 68 
32 39 56 69 
33 40 57 70 
34 42 58 72 
35 43 59 73 
36 44 60 74 
37 45 61 75 
38 47 62 76 
39 48 63 78 
40 49 64 79 
41 50 65 80 
42 52 66 82 
43 53 67 83 
44 54 68 85 
45 56 


Cross-validation of the Scale as a 
Prediction Instrument 


The prediction scale was tested on three 
new samples of psychotherapy patients, in order 
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to set whether it was doing the job for which 
it was designed. The patients were psycho- 
neurotic, the” psychotherapy was brief (very 
close to six months in all cases), and the clinical 
setting was similar to that in which the scale 
was developed. All of the patients took the 
MMPI at the beginning of therapy, and all 
were rated as to degree of improvement at 
some date following termination of therapy. 
The three cross-validating samples are de- 
scribed below. 


1. Fifty-three patients who were given psycho- 
therapy because of delayed recovery from injury or 
physical disease. Ratings of improvement were 
mad- hv expert judges (who had not taken part in 
the therapy) on the basis of terminal interviews. 
At a final rating conference, these 53 patients were 
ranked in terms of degree of improvement. This 
sample of patients had been studied some six years 
earlier by Harris and Christiansen [6], who showed 
that patterns of test scores on both the Rorschach 
and the MMPI were predictive of improvement. 
The same pretherapy MMPI’s were now scored on 
the prognosis scale. Only 39 items of the 68 could 
be used, however, as these patients had been given 
a shortened form of the MMPI, containing only the 
jtems which make up the clinical and validity scales 
of the test. The correlation with terminal rating is 
42. 

2. Fifty-two patients who had received brief psy- 
chotherapy during the preceding five years at Lang- 
ley Porter Clinic. The sample was obtained by ask- 
ing therapists who had worked at the clinic during 
that period of time to nominate patients whom they 
remembered as clear examples of exceptional im- 
provement, complete lack of improvement, and mod- 
erate improvement. The latter group consisted of 27 
patients, while the two extreme groups numbered 9 
and 16 respectively. The degree of relationship be- 
tween pretherapy prognosis scale scores and this 
trichotomy, as determined by computation of eta, 
is .54. The means were as follows: Unimproved, 
32.75; Improved, 43.07; Exceptional Improvement, 
49.66. 

3. Forty-six patients who were part of the cur- 
rent patient load on the psychiatric service of a 
general hospital. All of these patients had had ap- 
proximately six months of psychotherapy at the 
time the rating was obtained. Ratings were made 
by the therapists themselves, on a 9-point scale of 
improvement. The correlation with pretherapy prog- 
nosis scale scores is .38. 


These corselation coefficients are of about 
the magnitudë that one would expect for a 
scale which is giving a valid measure of patient 
variables related to outcome of psychotherapy. 
It is reasonable that there should remain con- 
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siderable unaccounted-for variance, quite apart 
from whatever error variance is contributed by 
the fallible criterion and predictor measure; 
for there are many important determinants of 
outcome of therapy besides the personality of 
the patient. The personality of the therapist, 
e.g., is also important; and, in addition, there 
is a subtle interactional factor which results 
from the combination of a particular patient 
with a particular therapist, which is not infre- 
quently the crucial determinant of outcome 10 
a given case. Then there are, of course, life- 
situational variables outside of the therapy, 2° 
fecting both patient and therapist, individually 
or jointly. It seems safe to say that no stant” 
ardized test is likely to achieve any very high 
order of correlation with therapeutic outcomes: 
At the same time, the effort to construct meas- 
ures of the different sources of variance ten i 
to advance the research problem somewhat, 
and to make new questions answerable. f ue 
scale presented here continues to prove effective 
upon further investigation, it opens the way t° 
an inquiry into the effect of the therapist’s pele 
sonality, intelligence, and social attitudes upo? 
therapeutic results, with the effect of patient 
stion, 
of course, lies the more difficult problem R 
measuring interactional effects, aC g- 
unique influence on the therapeutic relation 
ship. 
Summary and Conclusions de 
To recapitulate: an MMPI scale ee nse 
veloped for the purpose of predicting ia its 
to psychotherapy, and upon inspection ° ajli- 
item content and its personality and r eing 
gence test correlates it was interpreted as "here 
essentially a measure of ego-strengt? 5 Ego 
proposed that the scale be known 35 a cot 
strength scale of the MMPI, and that the 
ventional abbreviation for it should be Sper 
The relationship of the scale scores on ating 


. -ya 
in several crossV#" -geant 


peutic outcomes 
a sign" oe 

” 10° 
sa psy“ 


samples led to the conclusion that Pa 
determinant of personality change } thera?! 


therapy is strength of the ego before ; are 
begins. Among the characteristics. W aif phy 
collectively referred to as ego-strengt g tron? 
siological stability and good health, quad 
sense of reality, feelings of persona eth 
and vitality, permissive morality, /@° ont’ 


. . 5 ant ~” 
prejudice, emotional outgoingness 
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neity, and intelligence. 

Since the patients who seek psychotherapy 

are almost invariably in some sort of psycho- 
logical difficulty, it must be evident that these 
characteristics are usually not salient features 
of the clinical picture at first contact. The evi- 
dence suggests, however, that such strengths 
are latent in the personality, and that they 
emerge as therapy progresses. By implication, 
it seems probable that the kind of personal 
crisis which brings the person of good ego- 
strength to the clinic is more situation-linked 
and less characterologically based (i.e. less 
chronic) than the personal difficulties of the 
person with poor ego-strength. 
_ The scale should be useful both as a research 
instrument and as an additional clinical indi- 
cator on the MMPI. The present writer 
would suggest, however, that considerable cau- 
tion should be exercised in the clinical use of 
the scale. Certainly it should not serve as the 
basis for categorical recommendations to treat 
or not to treat certain patients; the grounds 
for such action in a clinic should properly in- 
volve values as well as facts, and in any event 
the kind of crude measuring device presented 
here represents a fairly low order of “fact.” 
Any prognostic assertions made on the basis of 
this scale should be quite tentative, and prob- 
ably should be accompanied by a visual image 
of the kinds of scatter plots which may give 
rise to correlations in the general neighbor- 
hood of .45. 

As a research instrument, the scale should 
prove useful in giving some assessment of the 
role of “patient variables” in determining the 
complex outcome which is involved in response 
to psychotherapy. It may also be of some value 
in assessing the kind of change that occurs in 
therapy. One may ask, for example, whether 
there is actually an enhancement of ego- 
strength as a consequence of therapy, and get 
an answer by comparing pretherapy with post- 
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therapy scores on the scale. Or one might in- 
quire whether the therapy itself is causing the 
change for the better in patients*who improve; 
evidence on the issue might be obtained by set- 
ting up a research design which would use as 
a control group a sample of patients who are 
matched with the therapy sample in terms both 
of Es scores and of present need for psycho- 
therapy, but who differ in that they do not 
receive psychotherapy. 

In addition, the scale may be useful as an 
assessment device quite apart from the clinical 
situation. Its correlates with personality vari- 
ables in normal samples are similar to the pat- 
tern of relationships seen in clinic samr's>,-and 
in general it seems to be measuring constructive 
forces in the personality. Thus it may serve 
as a predictor in any situation in which an 
estimate of personal adaptability and resource- 
fulness is called for. 
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MMPI Changes Concomitant with Client- 
Centered Therapy ` 


James J. Gallagher 


Michigan State College 


The problem of how to evaluate psycho- 
therapy seems often to be complicated by the 
larger problem as to what the goals in therapy 
are, or should be. Nowhere is this problem 
more evident than in the recent article by 
Eysenck [3] who reviewed the literature on 
evaluation of psychotherapy and came to the 
tentative conclusion that the available evidence 
fails to support the notion that psychotherapy 
facilitates recovery from neurotic disorders. To 
reach this interesting conclusion, Eysenck had 
to accept as equal or nearly equal the judg- 
ments of a great number of psychiatrists and 
physicians as to what constitutes cure or im- 
provement. He is probably right in stating 
that his conclusions will be looked on with a 
skeptical eye, although he assumes that it will 
be the result of an emotional block on the part 
of the skeptics rather than any methodological 
weakness leading to his own conclusions. It 
should be clear by now that “success in psy- 
chotherapy” is a value judgment concept, a 
fact which makes it difficult to find a defini- 
tion acceptable to everyone. The real problem 
to the science of psychology is that the many 
discussions and vituperative arguments as to 
what therapy should be have not advanced us 
too much further in our search of what 


therapy is. 

The writer would suggest that there is an- 
other and more profitable way of approaching 
this problem, namely, to demonstrate empiri- 
cally what changes do take place as a result of 
a particular type of therapy. Thus, objective 


1 The data for the present sudy were obtained as 
part of a group research project in psychotherapy at 
the Pennsylvaria State College. The coordinated 
portion of the research is being published under the 
title: Group report of a program of research in 
psychotherapy, Psychotherapy Research Group. 
Pennsylvania State College, in press. 


evidence will be available, regardless of wheth- 
er or not it is acceptable to various critics, as 
to what a therapy does do as distinguishe 
from what its followers feel it should do. 


Problem 


The present problem is to determine wheth- 
er there were any changes on the results © 
the MMPI after a group of college students 
had undergone client-centered therapy: 
the cases, predominantly college students) 
came to the Psychological Clinic for V4 
their personal adjustment were minutely oe 2 
amined by the group research project 1? viel 
chotherapy. Interviews were recorde d- 
transcribed, pretests and posttests Were ^ 3 
ministered, therapists’ ratings and ea 
judges’ ratings were obtained, etc. The presen 
study deals with the MMPI results and thei 
relationship with other measures of progress 
in treatment. peen 

Previous studies. Since the MMPI bas has 
a popular diagnostic instrument, researc stic 
been mainly confined to differential diagn’ Fa 
studies [6, 8, 9, 10, 11, 15], although “roy 
investigations have been completed on M jes 
changes as a result of various shock theraP 


LS h Bi 


who 


or 4 
ation of psychotherapy. Rashkis and Shaski® 
used the MMPI to evaluate group psychothe 
a permissive nature. Using a T score a 
a measure of deviation from the norma a state pr 
chiatric battle casualities and 15 anxiety é diret 
tients, they found the greatest changes 1 
tion of improvement in the D, Hy, Hs, e Mas 
The Pd scale remained unchanged an 
showed a tendency to increase. 
Schofield [16], reasoning that a cha 
sonality deviation should also meate u 
therapy, compared four groups of vo retheraP 
ing different types of therapy with P” 


k 
f pe 
measure © es if 
derg” 


ni and 
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posttherapy MMPI scores. He also attempted to de- 
velop a scale of items from the MMPI which would 
predict amenability to therapy. 

There were two groups of neurotic women, one 
treated on an outpatient basis and the other hospi- 
talized; and two groups of psychotic women, one 
group having electroshock treatment and the other 
having no shock treatment. These groups were dif- 
ferent from the population used in the present study 
in that they had limited education, average intelli- 
gence, were older, and all were women. 

The outpatient neurotic group that was being 
treated by junior medical students showed no sig- 
nificant changes on posttherapy MMPI’s. The hos- 
pitalized psychoneurotics showed significant differ- 
ences on the Hs, Hy, and Pd scales and a general 
lowering effect on the whole profile. The hos- 
Pitalized psychotics who had no shock treatment 
showed no significant changes on the posttherapy 
tests, while the psychotics who underwent shock 
treatment showed changes on the F, Hs, D, Hy, Pd, 
Pt, and Se scales, A group of nonhospitalized nor- 
mal women showed no significant changes on tests 
which were given with the same general time lapse 
as those of the therapy groups. 

Schofield’s attempt to establish a predictive scale 
for therapy was not successful, as there was too 
much overlap on the scale between the much im- 
proved and the slightly improved group. He attrib- 
uted his lack of success to a “lack of a reliable clin- 
ical criterion of patients’ responses to therapy.” 

Wiener and Phillips [18] studied the changes of 
the MMPI on a patient undergoing modified psycho- 
analysis (one hour a week). During a period of 
eight months there was noticed a strong drop in the 
D, Pt, and Sc scales and a moderate drop in the 
Hy and Pa scores. It was also noted that the K 
score went up and that these changes remained 
when the patient was re-examined a year after 
therapy was discontinued. 

Mosak [12] reported the results of 28 clients who 
had undergone client-centered psychotherapy for an 
average number of fifteen interviews. He reported 
that the posttherapy MMPI results indicated signi- 
ficant decreases on the D, Sc, Hs, Hy, and Pa 
scales. The individual profiles showed the same 
pattern as was observable on the pretherapy tests 
with a general drop in scores on all the scales. The 
Bell Adjustment Inventory, also given to the same 
clients, showed significant improvement in the feel- 
ings toward the self and toward others. 


Hypotheses. The following hypotheses were 
tested in the present study. 

1. Changes that take place as a result of 
e of psychotherapy should be reflected 
in subsequent changes in the results of person- 
ality tests. As there is a change in the direc- 
tion of health in the individual, there should 
be a corresponding depression in the scores 


any typ 


that represent maladjustment. 

2. It was expected that the greater the move 
to health in the individual, the-greater the ex- 
pected change in the personality tests toward 
health. Thus, a positive correlation between 
change in maladjustment scores on the MMPI 
and the criterion measures of success in psycho- 
therapy was expected. 

Method 
Subjects 

‘The 41 subjects involved in this study were 
all students of the Pennsylvania State College 
who came to the Psychological Clinic between 
September 1949 and August 1950, either by 
request of various agencies or upon thei~.own 
volition, to obtain aid in their personal ad- 
justment. All these subjects were counseled 
by advanced graduate students in clinical psy- 
chology who had been trained in client-centered 
therapy. No attempt was made to diagnose 
these cases prior to therapy except that persons 
judged as prepsychotic or psychotic on the 
basis of initial contacts were transferred to the 
staff psychiatrist. The median number of 
therapy interviews was between five and six, 
although some cases were seen for a much 
longer period of time. 

Figures obtained from the registrar of the 
college for the year 1949-1950 showed that 
the group who came for therapy was repre- 
sentative of the total college population for 
the semester enrolled, in age (mean = 21.75) 
and sex (75% males). There was a higher 
proportion of liberal arts students in the 
therapy group than in the general college pop- 
ulation. No evidence was available to suggest 
why this was so. 

Raw MMPI scores of 202 randomly select- 
a college students were used as a typical col- 
ege normative group with whic 
the therapy population. The rt ty ao 
for each of the MMPI scales y eet 

i was obtained 
and then converted into a T score so that 
comparison would bi i aoe 

i e possible. It would have 
been desirable to have a control group of l 
adjusted students who did not under a D : 
chotherapy. However, practical ila ea 
militated against such a procedure at this one, 

Procedure. A battery of tests consisti e 
the Rorschach, MMPI, and the Moone a i 
lem Check List was given to each of the 
subjects before the beginning of the uses 
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interviews or, at the latest, before the second 
therapy interview. The posttherapy tests were 
given after an agreement was reached by the 
therapist and client that the therapy contacts 
should end. 

In order to correlate the change on the 
MMPI with other measures of success, a mal- 
adjustment scale was developed to give one 
score which would represent the amount of 
deviance from the normal in each case. To 
obtain this score the deviant scores on all the 
items on the Hs, D, Hy, Pd, Pa, Pt, and Sc 
scales were summed. The Mf and Ma scales 
were not included because norms on college 
stud...t>.~evealed these scales to be unduly ele- 
vated. The procedure of summing the in- 
dividual items was done in preference to sum- 
ming the T scores, since some items appear on 
more than one scale and would be unduly 
weighted by such a procedure. 

The therapy criterion measures. A multiple 
criterion for evaluating client-centered psycho- 
therapy with college students was developed by 
Tucker [17] using the cases in the present 
group. This multiple criterion consisted of 
four measures: 

1. A 29-item Therapy Rating Scale scored 
by the therapist following the end of contacts 
with the client. 

2. The same Therapy Rating Scale scored 
by judges who read at least 60% of the tran- 
scribed interviews including the first and last 
interviews. 


3. A 14-item Client Rating Scale which the 
client filled out at the time he took the post- 
therapy test battery. 

4. The ratio of negative to positive feelings 
in the final interview as compared to the ratio 
of negative to positive feelings in the first in- 
terview. 

These four criterion measures were com- 
bined into a total criterion score by weighting 
each measure according to the ratio of its 
summed intercorrelation with the other three 
measures. All of the rating scales were con- 
structed especially for this study by members 
of the group research project. For further in- 
formation concerning the reliability of judges’ 

ratings, the construction of rating scales, etc. 
the reader is d to Tucker’s original work 
PE: e 


Table 1 
Pre- and Posttherapy MMPI Scores on Therapy 
Group Compared with Random Sample Group 
of College Students 


Random 
MMPI Pretherapy Posttherapy Sample 
Scale Mean Mean Mean 
T score T score T score 
N=4 N=4 N=202 
F Mean 57.92 55.45°° 57} 
Sigma 7:73 6.91 
K Mean 53.05 55.348" 53 
Sigma 6.45 8.89 8 
Hs Mean 55.17 51.71%* 47 
Sigma 12.85 9.28 4 
D Mean 67.10 60.88" 50 
Sigma 12.51 12.54 6 
Hy Mean 60.66 59.54 56 
Sigma 10.89 8.56 6 
Pd Mean 62.49 61.17 53 
Sigma 13.48 10.03 9 
Pa Mean 56.67 55.22 53 
Sigma 8.29 9.33 3 
Pt Mean 67.49 63.49" 47 
Sigma 8.52 11.83 1 
Sc Mean 64.43 62.20 49 
Sigma 12.72 11.68 n 
Ma Mean 57.17 58.97 37 
Sigma 7.98 7.70 it 
Si Mean 59.94 SEOs 
Sigma 11.32 10.02 ~ 
Mal. Meant 86.56 79.41% 


Sigma 17.51 18.04 = 


z Mam raw scores, core date 
stimated T scores on the basis of raw 5 sig” 
„* Difference between pretherapy and posttl ray 
nificant af 1% level of confidence. 

** Difference between pretherapy and pos 
nificant at 5% level of confidence. 


sig- 
ttherapy © 


Results es be 
1. Table 1 shows significant differen” n T 
tween pretherapy and posttherapy pae 
scores on the F, K, Hs, D, Pt, and + een 
There was also a significant difference iructed 
groups on the maladjustment scale cone ange 
especially for this study. These mea? jvidua 
include, of course, a great variety of a T- 
changes. Some cases showed a : les while 
score improvement on certain A up oe 
others, surprisingly enough, so opinio” i 
surge in their profiles. It was a 
most therapists handling such ae a of 
an upward surge was indicative al’s reata 
down of defenses and the indivic™! han 4 a 
: her than ajust 
awareness of his problems, rat ma adj"! 
dication of a sudden turn to greater 


ment. 
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2. All the scales, with the exception of K 
and Ma, showed a tendency to be lower on 
the posttherapy test. This finding agrees with 
Mosak, who reported a general lowering of 
all scales as a result of therapy. 

3. Despite a considerably lower mean score 
on posttherapy results, the mean T scores of 
the therapy group were still considerably high- 
er than the random sample group of college 
students. This would seem to suggest that a 
sizable amount of improvement might still be 
profitably made with the therapy group. It 
must be remembered that the posttherapy tests 
were given immediately after therapy had been 
completed. There seems to be some evidence 
[2] to suggest that further change and im- 
provement in the client takes place for a period 
after therapy has been completed. 

4. The scales generally regarded as the char- 
acter or behavior disorder scales, Hy, Pd, and 
Ma, showed the least tendency to change as 
a concomitant of client-centered therapy. Con- 
versely the feeling or discomfort scales, D, 
Pt, and Hs, showed the greatest tendency 
towards change. It should be noted that the 
character and behavior disorders have been 
traditionally the group considered least sus- 
ceptible to any kind of psychotherapy and this 
may be more evidence supporting that clinical 
finding, rather than a specific failing of client- 
centered therapy. 


Table 2 


Correlation of MMPI Maladjustment Change Score 
with Client-Centered Therapy Criteria 


Maladjustment 


Criterion 
measure change score 
Therapist Rating 15 
Judge Rating A 
Client Rating , oer 
P-N Feeling Ratio 4 
.41** 


Multiple Criterion 


N =30. 
Í Sienifcant at 1% level. 
++ Significant at 5% level. 


5. Table 2 shows the correlation of MMPI 
maladjustment change scores with the various 
criterion measures developed by Tucker. Al 
though there is a positive correlation with all 
four criterion measures, only the Client Rat- 
ing Scale and the Positive-Negative Feeling 
Ratio showed significant correlations with the 
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Maladjustment Change Scores. This would 
seem to represent another example of the phe- 
nomenon mentioned previously by Tucker [17] 
and Gallagher [4], that the client’s evaluation 
of his progress and the psychologist’s judgment 
of the client’s progress are fairly independent 
of each other. Since the MMPI is, by and 
large, a measure of self-evaluation, we would 
expect fairly high correlations between MMPI 
changes and Client Rating Scales and Positive- 
Negative Feeling Ratios. Similarly, we might 
expect low correlations between the therapist 
and judge’s ratings and the MMPI change 
scores, and this is what happened. 


Discussion 


The results of the present study seemed to 
indicate that there were some changes, as 
measured by the MMPI, taking place in a 
group of college students concomitant with 
client-centered therapy. It should be noted al- 
so that considerable changes took place despite 
two unfavorable factors present in this study: 
first, the use of relatively inexperienced thera- 
pists, and second, a shorter number of inter- 
views than is generally accepted as necessary 
to accomplish real change in a client. 

Also of interest was the fact that some scales 
were more susceptible to change than others. 
Generally it was the mood or feeling scales 
which showed the greatest change in the direc- 
tion of health, while the behavior or character 
disorder scales showed the least amount of 
change toward health. While this is generally 
true of all types of psychotherapy, consistent 
results along this line would suggest that those 
patients who show initially high scores in the 
behavior disorder scales might profitably be 
handled in some other fashion than by being 
submitted to psychotherapy, in this case, client- 
centered psychotherapy. 

Another finding of interest was that there 
seem to be two different and relatively in- 
dependent frames of reference towards success 
in psychotherapy; the client’s frame of refer- 
ence in which he estimates change that has oc- 
curred within himself, and the therapists’ 
frame of reference in which they estimate the 
amount of change that has taken place withi 
the individual. While we, as psycholo hy 
would like to believe that oie expert anina n 
are more accurate and more realistic in the 
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evaluation of actual change, it does not neces- 
sarily follow that this is so. Some further 
study in which the opinion of both client and 
therapist are checked against some observable 
behavioral change in the client would do much 
to clear up this problem. 

The existence of such different frames of 
reference would pose a particular problem for 
client-centered therapy, for if the client is to 
have the final and irrevocable decision as to 
when he will leave therapy, he may often leave 
a rather frustrated therapist behind, who feels 
that the client has escaped therapy with only 
some anxiety reduction rather than a perma- 
nent solution or adaptation to his problem. 
Certainly some effort needs to be made to 
bring these frames of reference into closer con- 
junction with each other. 


Summary 


Forty-two college students who underwent 
client-centered therapy from advanced gradu- 
ate students in clinical psychology were given 
a pretherapy and posttherapy battery of tests, 
one of which was the MMPI. The purpose 
of the present study was to determine if there 
were any changes in the MMPI concomitant 
with the application of therapy and to see how 
well the changes on the MMPI compared with 
a multiple criterion of success in therapy. 

The results showed significant differences in 
the direction of health on six of the MMPI 
scales with the greatest differences being shown 
on the feeling or mood scales, while the least 
differences were shown on the character and 
behavior disorder scales. The MMPI malad- 
justment change scores showed significant cor- 
relations with measures of self-rating of suc- 
cess in therapy and of change in ratio of posi- 
tive and negative feelings from beginning to 
end of therapy. 


Received January 23, 1953. 
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An Adjustment Score for Q Sorts 


Rosalind F. 


Dymond 


Counseling Center, University of Chicago 


One of the most serious of the difficulties 
faced by those who would undertake research 
on the results of psychotherapy 1s the selection 
of suitable criteria. The person who presents 
himself for therapy presumably feels in need 
of change. Therefore, to measure the effects 
of the therapy, there must be some method of 
assessing his status before and after therapy, 
and some explicit standard against which the 
change, if any, may be measured. Such a cri- 
terion measure would also make possible group 
comparisons such as the initial adjustment sta- 
tus of an experimental or therapy group in 
comparison to a no-therapy group, and the 
comparative standing of these two groups after 
the experimentals have completed their thera- 
peutic interviews. 

To provide one such measure for the pro- 
gram of research in therapy under way at the 
Counseling Center of the University of 
Chicago,? the Q-sort adjustment score was de- 
vised. The Q-sort instrument itself has al- 
ready been briefly described in this series [1]. 
It is a test made up of 100 self-referent state- 
ments which each subject was asked to dis- 
tribute into nine piles, putting a prescribed 
number of cards into each, making a forced 
normal distribution. The instructions are that 
he put the cards most descriptive of him as he 
sees himself at one end, and the least descrip- 
tive at the other, with the items about which 
he is indifferent or undecided falling at the 
center. The required distribution is as follows: 


This is one of a series of articles reporting a 
a research program in psychotherapy ang 
personality, which is being conducted by the staf 
of the Counseling Center of the University of Chi- 
cago. This research program is largely supported 
by grants from the Rockefeller Foundation through 
its Medical Division. Numbers I, II, and III in the 
series appeared in the Psychological Service Center 


Journal, 1951, 8, 3-165. 
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Most like me 


Pile no. 012 8 & & 6 FT 8B 
No. of cards 1 4 11 21 26 21 11 4 1 


Least like me 


The statements to be distributed were com- 
piled by John Butler and Gerard Haigh? from 
therapeutic interviews so as to represent both 
the positive and negative statements that clients 
frequently make about themselves. As has been 
outlined by Grummon [1], both the experi- 
mental and control subjects in the research on 
Block I sorted these cards at various times. 
To review the design briefly, Block I of this 
program involved an experimental group of 
twenty-five cases selected randomly from those 
presenting themselves for therapy and a con- 
trol group of equal size of “normals.” The 
control group is normal in the sense that they 
had never had any psychotherapy and were 
not at the time of selection so motivated. They 
were individually matched with the experi- 
mental subjects on age, sex, socioeconomic 
status, and occupation. To control for the pos- 
sible effect of the passage of time, the tests 
for the controls were spaced at the same in- 
tervals as those of the therapy cases with whom 
they were matched. This also gives control over 
the possible effect of repeated testing. There 
was no attempt to match on such factors as 
psychological status, personality variables, or 
motivation for therapy. These were handled by 
using an “own-control” design as well. The 
experimental (therapy), and the control (no- 
therapy) groups were each subdivided into an 
A and a B category. The experimental 4’s 
were given a battery of tests two months before 
their therapy began, and again just before their 


2 Haigh, G., & Butler, J. Proposa? for rese: 
changes in perception of self and others in ee zo 
In First interim report of the Rockefeller TEER 
project. Univer. of Chicago, unpubli : 
script, pp. 12-15. , lie 
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therapy started. This made available a measure 
of their pretherapy psychological status, and 
also permitteď a comparison of their prewait 
and pretherapy tests to reveal the extent to 
which a group motivated to seek therapy would 
change in a positive direction, in a two-month 
inferval, without the help of therapy. A posi- 
tive shift between these two sets of test scores 
in the experimental group during the no-ther- 
apy waiting period would indicate that the im- 
portant variable in “improvement” is not the 
therapy but the motivation. However, if the 
control group which is not motivated for ther- 
apy were to show a shift of the same magni- 
tuds, the change might better be attributed to 
the practice effect resulting from retesting. 


The experimental B group had no waiting 
period but was first tested just before its ther- 
apy began. As the control sample was tested at 
the same time intervals as its experimental 
match, for half the sample of both experiment- 
als and controls there were four sets of tests: 
prewait, pretherapy, posttherapy, and follow- 
up (six months after the posttherapy tests). 
For the other half, there were three testing 
points: pretherapy, posttherapy, and follow-up. 


To obtain an adjustment criterion against 
which any particular person’s distribution of 
the cards could be scored, the entire group of 
100 statements was given to two well-trained, 
practicing clinical psychologists from outside 
the client-centered orientation. They were 
asked to sort the statements into two piles, 
those the well-adjusted person should say are 
like him, and those the well-adjusted person 
should say are unlike him. Both judges felt 
that some items were irrelevant to one’s adjust- 
ment status, and were permitted to omit these 
items from their sortings. The two distribu- 
tions made by the two judges agreed remark- 
ably well, differing on only 2 of the 100 items. 
Next, the 26 statements which the initial two 
greed did not differentiate adjustment 
ded, and four new judges were 
aining 74 to sort. The new judges 
were asked to make two equal piles, so that 
there would be 37 items that the well-adjusted 
individual would say are like him, and 37 he 
pana like him. Again the agreement 


ay are un A z 
Only one judge differed on the placement of 


judges a 
were discar 
given the rem 


Rosalind F. Dymond 


as many as four items. The composite picture 
of the self-description of the well-adjusted per- 
son was then tabulated as 37 positive indicators 
on the “like me” side of the distribution (from 
scale position 5 to 8), and 37 negative indi- 
cators on the “unlike me” side (between 3 and 
0). Table 1 lists these items. 


Table 1 
Adjustment Score Items 
Negatives: Contribute to score if fall on “unlike 

me” side (0-3) 
1. I put on a false front. 
2. I often feel humiliated. 
3. I doubt my sexual powers. 
4. I have a feeling of hopelessness. 
5. It is difficult to control my aggression. 
6. I want to give up trying to cope with the 


world. 

7. I tend to be on my guard with people who are 
somewhat more friendly than I had expected: 

8. I usually feel driven. 

9. I feel helpless. 

10. My decisions are not my own. 

11. I am a hostile person. 

12. I am disorganized. 

13. I feel apathetic. 

14. I don’t trust my emotions. 

15. It is pretty tough to be me. 

16. I have the feeling that I am just not 
things. 

17. I try not to think about my problems. 

18. I am shy. 

19. I am no one. Nothing seems to be me 

20. I despise myself, 

I shrink from facing a crisis or diffculty: 

22. I just don’t respect myself. ent 

23. I am afraid of a full-fledged disagree™ 
with a person. 


facing 


or 
24. I can't seem to make up my mind one way 
another. 
25. I am confused. 
26. Iam a failure. 
27. I am afraid of sex. I want 


28. I have a horror of failing in anything 
to accomplish. 

29. I really am disturbed. r 

30. All you have to do is just insist wit 
I give in. 

31. I feel insecure within myself. 

32. I have to protect myself with € 
rationalizing. 

33. I feel hopeless. 

34. I am unreliable. 

35. I am worthless. 

36. I dislike my own sexuality. 

37. I have few values and standards © 


h me and 


it! 
xcuses, w 


£ my own 


~~ 
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Positives: Contribute to score if fall on “like me” 


side (5-8) 
1. I am likeable. 
2. My personality is attractive to the opposite sex. 


3. I am relaxed and nothing really bothers me. 


4. am a hard worker. 

5. feel emotionally mature. 
6. am intelligent. 

7 am self-reliant. 

8. am different from others. 
9; understand myself. 

10. am a good mixer. 

ait. feel adequate. 


isfied with myself. 


I 
uf 
I 
I 
I 
I 
I 
I 
I 
I 
I 
15. I have initiative. 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 


am assertive. 
14, I take a positive attitude toward myself. 
16. am ambitious. 
17. have an attractive personality. 
18. am tolerant. 
19. am a rational person. 
20. am impulsive. 
21. I am poised. 
22. am contented. t r 
23. can usually make up my mind and stick to it. 
24, am sexually attractive. 
25. Iam liked by most people who know me. 


26. I am optimistic. 

27. My hardest battles are with myself. 

28. I can usually live comfortably with the people 
around me. 

29. I express my emotions freely. 

30. I usually like people. 

31. Self-control is no problem to me. 

32. I can accept most social values an 

33. I am a responsible person. F 

34. I have a warm emotional relationship with 
others. 

35. I often kick myself for the things I do. 

36. I am responsible for my troubles. 

37. I make strong demands on myself. 


d standards. 


Any person’s resemblance to this ideal type can 
be computed by counting the number of the 
items which he places on the appropriate side of 
the distribution when describing himself. This 
tally was called the adjustment score. 


Table 2 


Adjustment Score of “A” Group in the 
No-Therapy Period 


Experimental Control 
Test group group 
F (N=11) (N=11) 
Mean Range Mean Range 
Prewait 28.7 16-36 47.0 25-58 
Pretherapy 31.2 14-41 47.4 27-58 


Results 


The mean adjustment score of the members 
of the experimental 4 group at the prewait 
testing time showed that they described them- 
selves as significantly poorer in adjustment 
than the no-therapy group, as indicated by the 
t test. The mean adjustment score of neither 
the experimental nor the control 4 group 
changed significantly over the waiting period, 
and the two remained significantly different at 
the 1 per cent level (Table 2). Thus neither 
motivation to change nor familiarity with the 
test seemed to be sufficient in itself to produce 
a significant increase in adjustment score dur- 
ing the two-month waiting period. 

Although the control testing pr¢gram 1s not 
yet complete, a comparison of the 15 completed 
cases with the 25 experimentals can be made 
(Table 3). 


Table 3 , 


Adjustment Score of Total Group over the 
Therapy Period 


Experimental Control 
Test group group 

(N=25) (N=13) 

Mean Range Mean Range 
Pretherapy 28.9 11-42 47.4 27-60 
Posttherapy 39.9 17-54 45.6 27-56 


In comparing the pre- and posttherapy mean 
scores, the experimentals are found to increase 
their adjustment scores significantly over the 
therapy period, whereas the no-therapy group 
does not. At the posttherapy testing time, the 
experimental group mean is not significantly 
different from the control group mean. 


In sum, the group which presumably was 
motivated to change in some way described 
themselves as poorer in adjustment than a 
group that was not so motivated. With the 
intervention of therapy, this group described 
themselves as psychologically better in adjust- 
ment than previously, and approached the level 
of a “normal” group without the therapy ex- 
perience. 


Discussion 
How good a criterion is che Q-sort meas- 
ure? As this is a self-descriptive measure of 
adjustment, how well does it agree with a 
. 
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more “objective” measure? Table 4 shows the 
relation of the Q-sort adjustment score to the 
counselor's rating of the success of the therapy. 
Using Yates’s exact method for determining 
the significance of the relationship, it was 
found to be significant at the 5 per cent level. 


Table 4 


Relation of Q Adjustment Score of Experimental 
Group after Therapy and Counselor’s 
Rating of Success 


Success rating 


Q Adjustment Low High 
score 1-5 6-9 
-Low « 
(17-38) 7 4 
High 
(39-54) 3 11 


It may be argued that these two measures 
are not independent of each other and that 
neither is a valid measure of adjustment. The 
counselor’s judgment of the success of the 
therapy may be influenced by the client’s use 
of well-adjusted self-references in the inter- 
views, and the therapist’s attitude of satisfac- 
tion with the progress may be communicated 
to the client who then reflects it in his self- 
description. There is some possibility that the 
adjustment score of the follow-up sort may 
contribute an answer. If the client’s postther- 
apy self-description was greatly influenced by 
a “need to please” the therapist, or even to 
prove to himself that he had profited from the 
time spent in therapy, some of this motivation 
should have been reduced in the intervening 
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six months. If the gains from therapy were 
really superficial or minimal and the adjust- 
ment score increase wholly spurious, the self- 
description done six months after therapy 
might be expected to be somewhat less influ- 
enced by the “hello-goodbye effect” [2, P- 
228]. The fact that the mean follow-up ad- 
justment score of the therapy group, based on 
22 completed cases, is almost identical (38.3) 
to the posttherapy mean (39.9) seems to indi- 
cate some lasting improvement. The follow-up 
tests of the control group are not yet complete 
enough to report. 


Summary 


An index of adjustment based on a Q-sort 
technique shows a group of persons presenting 
themselves for therapy to be less well-adjusted, 
as measured against a criterion set up by expert 
clinicians, than a group who do not wish ther- 
apy. After therapy there is a significant im- 
provement in the experimental group, whic 
is then not significantly different from the no- 
therapy group. There is, further, a significant 
concurrence between counselors’ judgments 0 
the success of the therapy and the final adjust 


ment status as measured from the self-descriP~ 
tion. 
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The Appraisal of Body-Cathexis: Body-Cathexis 
and the Self 


Paul F. Secord and Sidney M. Jourard 


Emory University 


A substantial amount of current research in 
personality is devoted to the study of the in- 
dividual’s personal world. One object which is 
ever-present in this personal world is the body. 
It is the thesis of the present writers that the 
individual’s attitudes towards his body are of 
crucial importance to any comprehensive theory 
of personality; yet little attention has been 
given to this subject by psychologists. The 
present paper is concerned with one variety 
of attitude, namely, body-cathexis. By body- 
cathexis is meant the degree of feeling of sat- 
isfaction or dissatisfaction with the various 
parts or processes of the body. 

If the variable body-cathexis is to be deemed 
important for personality theory, it is neces- 
sary to demonstrate that it is related to other 
personality variables which are recognized as 
significant. For reasons which need not be dis- 
cussed here, body-cathexis is believed to be in- 
tegrally related to the self-concept, although 
identifiable as a separate aspect thereof. From 
this notion of relatedness of body and self, the 
following more specific hypotheses were formu- 
lated and tested : 

1. Feelings about the body are commensu- 
rate with feelings about the self, when both are 
appraised by similar scales. 

2. Negative feelings about the body are as- 
sociated with anxiety, in the form of undue 
autistic concern with pain, disease, or bodily 
injury. 

3. Negative feelings about the body are as- 
sociated with feelings of insecurity involving 


the self. 


One of the few empirical studies relevant to the 
present focus is that of Schilder [4], who used a set 
of questionnaires which probed the feelings, associa- 

jes of his patients toward various 


tions, and memor! 
aspects of their bodies. These semiobjective ques- 


tionnaires suggested the more objective scale em- 
ployed in the present study. Another relevant paper, 
that of Secord [6], describes the use of a homonyat 
word-association technique for the :-ppraisti of 
body-cathexis in a disguised “projective” fashion. 
This technique was used here for purposes of com- 
parison with the more direct BC-SC Scale. 


The BC-SC Scale 


The writers approached the problem of ap- 
praising body-cathexis (BC) by asking the per- 
son to indicate on a scale the strength and di- 
rection of feeling which he has about each of 
the various parts or functions of his body. Such 
a direct approach, of course, has certain of the 
theoretical disadvantages which the more typi- 
cal self-inventories also possess, but it was be- 
lieved that the technique might have some use- 
fulness in spite of these limitations. The first 
part of this scale consisted of a listing of 46 
body parts and functions. Each item was fol- 
lowed by the numbers 1 through 5. The fol- 
lowing instructions appeared on the cover page 
of the scale: 


On the following pages are listed a number of 
things characteristic of yourself or related to you. 
You are asked to indicate which things you ate 
satisfied with exactly as they are, which things yo 
worry about and would like to change if it = 
possible, and which things you have no feeli . 
about one way or the other. g mape 

Consider each item listed below and encircle th 
number which best represents your feelings a = 
ing to the following scale: j ERa 


1. Have strong feeli i 
aTa EE EN and wish change could 
2. Don't like, but can put up with. 
3. Have no particular feelings one way or the 
other. 
4. Am satisfied. 
5. Consider myself fortunate. 


The second part of the scale concerned self- 


343 


344 


cathexis (SC), and listed 55 items believed to 
represent a sampling of the various conceptual 
aspects of the self, which were rated by the 
respondents according to the same instructions 
used for the body scale. The self-traits in- 
cluded were phrased in nontechnical, popular 
terms, such as morals, conscience, and person- 
ality, so that they might approximate the terms 
in which the individual actually thinks of him- 
self. Tables 1 and 2 list the items included in 
both parts. 


Table 1 
Body-Cathexis Items Used in BC Scale 


hair width of shoulders 

facial complexion arms 

appetite chest 

hands eyes 

distribution of hair digestion 
over body hips 

nose skin texture 

fingers lips 

elimination legs 

wrists teeth 

breathing forehead 

waist feet 

energy level sleep 

back voice 

ears health 

chin sex activities 

exercise knees 

ankles posture 

neck face 

shape of head weight 


body build sex (male or female) 


profile back view of head 
height trunk 
age 

Table 2 


Self-Cathexis Items Used in SC Scale 


sensitivity to opinions 


first name 

morals of others 

ability to express self ability to lead 
taste in clothes last name 

sense of duty impulses 
sophistication manners 
self-understanding handwriting 

life goals intelligence level 
artistic talents athletic skills 
tolerance happiness 

moods fe creativeness 
general knowledge love life E 
imagination strength of conviction 
popularity conscience 


self-confidence skill with hands 
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fears 

capacity for work 
conscientiousness 
ability to meet people 


ability to express 
sympathy 

emotional control 

self-consciousness 


generosity self-discipline 
ability to accept criticism suggestibility 
thoughts neatness 
artistic & literary taste vocabulary 
memory procrastination 
thriftiness will power 


self-assertiveness , 
ability to make decisions 
dreams 


personality 
self-respect 
ability to concentrate 
ability to take orders 


The form of the scale presented in Tables 
1 and 2 is the result of considerable prelimi- 
nary work in which previous forms were trie 
out on college students. Items which were 
difficult to understand, dificult for the subject 
to assign a meaningful rating, or which re- 
sulted in little variability from subject to sub- 
ject were generally eliminated, provided that 
they did not leave an important part of the 
body or self unrepresented. One exception t° 
the latter qualification was allowed: 0rga”$ 
pertaining to sexual and excretory functions 
were deliberately omitted from the body list 
because it was feared that their presence in the 
scale might give rise to an evasive attitude 
which would transfer to other items, result- 
ing in an avoidance of the two answer cate- 
gories representing negative feelings towards 
the body. 

The homonym test of body-cathexis (H 
test). The H test consisted of a list © 
homonyms, each of which has meanings 
taining to the body and meanings not Te une 
to the body. A substantial proportion of a 5 
words have meanings pertaining to palm or 
ease, or bodily injury. Twenty-five neutral 9 
nonbody words were interspersed with list 
homonyms for purposes of disguise. This sik 
was presented to the testees orally, the hom! é 
nyms being read at the rate of one every 
seconds, with instructions to the subjects t° 
spond by writing down the first wor qual 
occurred to them. A score for each indiv? dily 
was obtained by totaling responses tO or 
meanings. It was employed here 
an independent measure of anxiety-relate heres 
This test has been fully described ee 4 
and some tentative evidence that: it 7 


per- 


re- 


rov. 
to P Gs 


ing 
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to anxiety has been offered [5, 6]. 

Procedure. The H test and the BC-SC 
Scale were administered in a group situation 
to 70 college males and 56 college females. 
The BC-SC Scale and the Maslow Test of 
Psychological Security-Insecurity [3] were 
subsequently administered to an additional 
group of 47 college men and women. , 

A study of the patterns of responses of in- 
dividuals to the BC-SC Scale suggested that 
response sets were operating for some individu- 
als [1, 2]. In order that split-half reliability 
coefficients for the BC and SC scores, as well 
as intercorrelations between these scores, might 
not be inflated by the artifact of response sets, 
subjects falling in any of the following arbi- 
trary classes were not included in computa- 
tions: (a) a frequency = 32 in category 4; 
(b) a frequency = 28 in category 5; and (c) 
a frequency = 24 in category 5, when ac- 
companied by less than 2 responses in cate- 
gories 1 and 2 combined. As a result, the 70 
male subjects were reduced to 45, and the 56 
females to 43. It should be emphasized that 
this selection of subjects Jowers the correlation 
coefficients obtained between parts of the BC- 
SC Scale, and reduces the split-half reliabili- 
ties of the various subscores. 


Results 


Statistics pertaining to the BC-SC Scale and 
the homonym test. A single score for each in- 
dividual was obtained on the H test, consist- 
ing of the total number of body responses to 


Table 3 
Means, Standard Deviations, and Reliabilities of 
the BC-SC Scale and the Homonym Test 
(N = 45 males; 43 females.) 


Test Mean SD Reliability* 
Homonym test 

Males 22.00 6.04 63 

Females 21.14 5.70 66 
Body-Cathexis 

Males 3.43 337 -78 

Females 3.46 401 «83 
Self-Cathexis 

Males 3.43 -393 88 

Females 3.35 510 92 
Anxiety indicator 

Males 3.09 524 72 

Females 3.05 625 73 


* Corrected by the Spearman-Brown formula. 
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the 75 homonyms. Three types of scores were 
obtained on the BC-SC Scale. These were: 


1. Total BC, obtained by summing the ratings for 
each individual on the 46 body items and dividing 
by 46. 

2. Total SC, obtained by summing the ratings for 
each individual on the 55 self items and dividing 
by 55. 

3. An anxiety-indicator score, obtained by sum- 
ming the ratings for each male individual on the 
11 BC-Scale items most negatively cathected by the 
group of males: facial complexion, nose, energy 
level, body build, profile, height, chest, teeth, sex 
activities, posture, and weight. These sums were di- 
vided by 11. A similar score, based on tke 11 items 
most negatively cathected by females, was alsg.oh: 
tained. > 


Split-half reliability coeficients were ob- 
tained for all of the above scores. These are 
given in Table 3. Reliability coefficients for 
the homonym test are about .15 lower than 
those obtained in previous studies, but are still 
satisfactory. Reliabilities for the various BC- 
SC scores are moderately high; they may be 
regarded as more impressive when it is re- 
called that subjects displaying the most con- 
sistency were removed from the sample. 

No important differences between means of 


the various scores for the two sexes were ob- 
tained. 


Table 4 


Intercorrelations between BC-SC Scores, the Homo- 
nym Test, and the Maslow Test 
(N = 45 males, 43 females; except for the Maslow 
test, for which N = 46 males and females.) 


Test Body- Self- Anxiety 
Cathexis Cathexis Indicator 

Homonym test pe 

Males —.18 -.15 ~.37* 

Females —.419* —.23 —,.40** 
Maslow test e Y ia —.52** —41"* 
Self-Cathexis 

Males .58%0 

Females 66** 


Significant at the .05 level. 
** Significant at the .01 level. 


Relationship between body-cathexis and self- 
cathexis. Intercorrelations between total BC 
scores and total SC scores are shown in Table 
4. The r for men is .58, and for women, .56 
suggesting that individuals have a moderate 
tendency to cathect their body to the same de- 
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gree and in the same direction that they cathect 
their self; that is, the two kinds of cathexis 


covary. 

Relationships between body-cathexis and the 
homonym test. An examination of Table 4 
reveals no significant correlations between the 
H test and BC, for the 45 males, or between 
the H test and SC. There was, however, an 
r of —.37 between the H test and the anxiety- 
indicator score which, although low, was sig- 
nificant at the .02 level. For the 43 females, 
on the other hand, correlations significant be- 
yond the .01 level were obtained between H- 
test scores and BC (r = —.41), and H-test 
scores and‘ the anxiety-indicator score (r = 
—.40). Correlations between homonym scores 
and SC were not significant. In general, then, 
there is a low but significant relationship be- 
tween BC as measured by the scale and anxi- 
ety-related BC as measured by the H test. 


A concrete case may perhaps serve to indi- 
cate more specifically the manner in which the 
BC Scale and the H test concern anxiety. 


A woman with an extremely high H-test score 
and an extremely low BC score responded to the 
test items in the following way: 

1. Items on the BC Scale rated in category 1 
(Have strong feelings and wish change could some- 
how be made) were: facial complexion, appetite, 
hands, distribution of body hair, nose, fingers, waist, 
energy level, ears, body build, skin texture, knees, 
and weight. Items rated category 2 (Don’t like, but 
can put up with) were: hips, sleep, sex activities, 
and posture. None of the 46 body items were rated 
in category 5 (Consider myself fortunate). 

2. On the homonym test, responses to meanings 
pertaining to the body, body processes, or pain and 
disease are shown below, preceded by the homonym 
stimulus word in italics: acid-sour, arch-bend, back- 
broken, bare-ugly, condition-sick, crisis-sick, en- 
larged-grown, extract-tooth, function-stomach, gag- 
whiskey, gall-bile sac, gas-dying, glassy-dead, pa- 
tient-doctor, rash-heat, red-hands,  scarlet-disease, 
side-hutt, sling-broken arm, stain-blood, stiff-corpse, 
strip-New Orleans, system-biology, tablet-sleeping 
pill, tan-Daytona Beach, tape-sprained ankle, tender- 
skin, trunk-body, and qwaist-starve. — 

These item responses give some idea of the im- 
portance of the body to this woman and reveal her 
anxiety concerning it. A consideration of the diverse 
nature of the processes involved in the BC Scale 
and the H test a% revealed by these items lends sig- 


nificance to the correlation obtained between these 


two tests. 
Sex differences in degree nf cathexis. It was 
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found that females cathect their bodies, irre- 
spective of direction, more highly than do 
males, in that they do not assign as many 3's 
to body items (3 — Have no particular feelings 
one way or the other). The mean number 0 
3’s for all of the 46 body items was 10.76 for 
men, and 7.86 for women. This difference 0 
2.90 yielded a critical ratio of 1.92, which ap- 
proached significance at the .05 level. Con- 
sistent with this datum is the greater variabi s 
ty of BC scores among women, as previously 
shown in Table 3, although this difference 17 
sigmas is not significant. 

Relationships between the Maslow tes 
the BC-SC Scale. The Maslow test was foun 
to correlate —.37 with BC, —.41 with the 
anxiety-indicator score, and —.52 with e 
These r’s are significant at the .01 level. , F 
may be concluded that low cathexis is associa- 
ted with insecurity to some degree. 


t and 


Discussion 
ne is the 
One of the most significant results 1 th 
demonstration that the body and the self ten 


to be cathected to the same degree. This SU?” 
ports the hypothesis that valuation of the body 
and the self tend to be commensurate. 

Since the persons who obtain a high s¢ 
on the H test are regarded as being more 
anxious concerning their bodies than thos¢ i 
taining a low score, a moderate negative cor 
relation would be anticipated between Can R 
the H test. This is consistent with the neg 
ative r actually obtained for women. digs 

In the case of men, the relative lack of BE 
nificant relationships between the homon ly 
test and the BC-SC Scale cannot be clear 
explained on the basis of available dat® 
likely but unproved hypothesis is th 
are more likely than men to develop 2P” +1 
concerning their bodies, because of the 
importance of the female body. This hypo 
is consistent with the datum that w ir 
cathect their bodies more highly than oa with 
respective of the direction of cathex!s, r ly 
the fact that when a BC score based 0° 
those body items most frequently arousing ifi- 
ative feelings in men was employed, 4 
cant r of —.37 was obtained for men 2 
this “‘anxiety-indicator” score and F-test 6 BC 

A final support for the interpretatio" e sig 
as a self-related variable is found 1" 


ore 


-e 
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nificant correlation between BC and insecurity, 
as measured by the Maslow test. 


Summary and Conclusions 


The purpose of the present study was to de- 
velop a method for appraising the feelings of 
an individual towards his body and to ascer- 
tain whether or not variables derived from 
these appraised feelings are significant for per- 
sonality theory. The latter was determined by 
testing the hypotheses stated under 2, 3, and 
4 below. 

A scale for the determination of the degree 
of cathexis towards various aspects of the body 
was designed and administered to groups, of 
college males and females, along with a similar 
scale for aspects of the self, a homonym test 
of anxiety-related body-cathexis, and the Mas- 
low Test of Psychological Security-Insecurity- 

The following conclusions may be drawn: 

1. The split-half reliabilities of the two 
parts of the scale were found to be satisfactory: 
.81 for body-cathexis, and 90 for self-cathexis. 

2. The hypothesis that feelings about the 
body are commensurate with feelings about the 
self was supported by significant correlations 


between the two parts of the scale. a 
3. The hypothesis that low body-cathexis 1s 


associated with anxiety in the form of undue 
autistic concern with pain, disease, or bodily 
injury was upheld by the demonstration of 
significant relationships between low body- 
cathexis as determined by the scale and by the 
homonym test. 

4. The hypothesis that low body-cathexis is 
associated with insecurity was sustained by the 
demonstation of correlation between the form- 
er and the Maslow test. 


Received January 19, 1953. 
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This is the first of two investigations de- 
signed to study differences in the Rorschach 
protocols of patients who remain in therapy 
and those who do not. The present paper is 
concerned with the meanings of the scoring 
categories that differentiate between these 
groups. A subsequent report will be devoted 
to the development and validation of a pattern 
of signs that can be used in the clinic to predict 
duration of therapy. 

In the establishment of valid prognostic 
signs on any projective instrument, the re- 
searcher is beset by numerous difficulties. The 
patient’s behavior in therapy is related not only 
to his character structure but also to such 
interacting sources of variance as the ther- 
apist’s skill, stability in the patient’s working 
hours and his place of residence, and financial 
arrangements. In connection with the interpre- 
tation of the Rorschach protocol, the experi- 
menter must take into account such sources of 
variance as the setting in which the test is ad- 
ministered, the patient’s ego-involvement, and 
the examiner’s character structure [4]. Finally 
the success of the experiment may depend upon 
the accuracy of decisions concerning such as- 
pects of the design as the nature of the sample, 
kinds of controls, and appropriate cutting 
points in duration of therapy for identifying 
the different groups. Negative results are in- 
determinate, while positive results raise more 
questions concerning their theoretical signifi- 
cance than they answer. 

In view of the bewildering complexity of 


1From the Veterans Administration Regional Of- 
fice, Detroit, Michigan. 


variables, it is not surprising that there are 
very few studies of prognosis in therapeutic a 
other situations. However, an increasing num 
ber of investigations are being motivated by the 
fact that clinicians stake their professional rep” 
utations upon their abilities to make even more 
complex analyses than those of the present 
study. For example, reports may contain pre- 
dictions of the patients’ relationships tO the 
therapists or warnings of the probable dangers 
of depth therapy. While the interpretations 
are sometimes incorrect, many psychologists 
can cite instances of predictions of behavior 
that were borne out in great detail, far beyo” 
chance, by subsequent events. It is hoped that 
investigations such as the present one will con- 
tribute to an understanding of the processe 
that are involved in the development of these 
accurate predictions. 


Subjects 


Setting. Subj mea from among 
g. Subjects were selected Men- 


patients at the Veterans Administration Th 
tal Hygiene Clinic, Detroit, Michigan- 1S. 
work of this clinic is performed by five aa 
each consisting of a psychiatrist, psycholog in 
social worker, and two or three trainees 
clinical psychology. To each team are aS? 
all patients who register on a particula dul- 
of the week. Since there is no policy of ase 

ing any type of problem for registratlo? " 
particular day, various pathologies a 
domized among the different teams- 

tion of the incidence of different syndr 
the subjects of the present study reve? 
significant differences among the tear ater” 

After the patient registers, he 1 first 
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viewed by the social worker, who notes his 
complaint and source of referral, takes a case 
history, and writes a report attempting to for- 
mulate his dynamics. Then the psychiatrist 
conducts a diagnostic interview. Following pre- 
liminary discussion by the team, the case may 
be referred to the psychologist for diagnostic 
evaluation. After this procedure, the team holds 
a planning conference to review the data and 
decide upon final recommendations. When they 
decide upon therapy, the patient may be re- 
ferred to either a psychiatrist, psychologist, or 
social worker. ae 
General criteria. For purposes of simplify- 
ing the analysis of data, a number of criteria 
were utilized in the selection of the initial 
pools of subjects. ‘The age range was restricted 
by eliminating veterans of the first World 
War. Only males were used. Finally, cases of 
organic brain damage and disoriented psychot- 
ics were rejected in order to maximize Co- 
operation in the administration of tests and 
insure the possibility that all subjects could 
have profited from therapy. N , 
Criteria for selection of groups. This investi- 
gation involved the comparisons of the proto- 
cols of three groups. All members of the first 
group were receiving psychotherapy at the 
time data were collected and had been in treat- 
ment continuously for at least six months. Be- 
cause visits to the clinic by different patients 
varied between one and three times per Weck; 
the number of sessions in this group ranged 
between 27 and 305; the mean is 121. — 
Group II consisted of subjects who discon- 
tinued therapy prior to the sixth session against 
the therapist’s advice. Care was taken not to 
include individuals who had to terminate treat- 
ment because of circumstances beyond their 
control, such as change in working hours or of 
residence. The number of therapeutic appoint- 
ments ranged between one and five, with a 
mean of 2.7. In order to control for the skill 
of the therapist, the design required that each 
ribute an equal number of patients to the 
first two groups. Sixty-six cases were found 
who conformed to the general criteria and 
could be paired in terms of their common ther- 
apists. Thus 33 were assigned to each group. 
Like the other subjects, members of Group 
III were processed by their teams and advised 
to undertake psychotherapy- Unlike the others, 


cont 
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they refused treatment. Of the cases in the 
files who met the criteria, 33 were chosen at 
random, care being taken not to include those 
who declined therapy because of situational 
factors beyond their control. 

Therapists. Of necessity, the procedure of 
selecting patients simultaneously determined 
the population of therapists. It may help in 
the interpretation of results to discuss some of 
the characteristics of this population. There 
were ten therapists in all, four psychiatrists, 
four clinical psychologists, and two social 
workers. In the three professional groups, there 
were considerable variations in the amounts of 
experience with adult neurotics and psycho“ ise 
The psychiatrists varied between one and five 
years of practice beyond the residency. Among 
the psychologists, the least experienced had re- 
ceived a full year of supervised therapy beyond 
the completion of the doctoral degree; the most 
experienced had spent half of her twelve years 
of clinical work in therapeutic practice. The 
two social workers had two to five years of 
practice in psychotherapy beyond their formal 
training. 

In the Detroit clinic, cases are presented 
regularly in staff conferences conducted by 
psychiatric consultants, who are all psycho- 
analysts. The considerable influence of these 
consultants is manifested by the psychoanalyt- 


Table 1 
Characteristics of Population of Patients 


S 
II. 
t I. Five III. 
Six months sessions Refused 


Variable or longer or less therapy 
N 33 33 33 
Mean age 31 28 30 
Education: mean grade 10.8 10.5 9.4 
No. of therapists 10 10 es 
White 31 30 24 
Negro 2 3 9 
Referred by medical clinic 20 21 22 
Referred by vocational 

rehabilitation 1 3 4 
Self-referred 12 9 3 
Diagnosed neurotic 27 - 22 18 
Diagnosed schizophrenic 

reaction 4 8 8 
Diagnoses deferred 2 
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: Table 2 
Differences in Absolute Scores of Groups 
Rorschach Mean of Group SD of Group CR 
Score I IL Il I il lll iti I-II Ill 

R 31.5 20.2 18.2 17.5 9.7 8.3 3.2%% 3.9% 10 
w 6.6 5.1 6.4 4.9 3.7 3.3 1.4 2 1.5 
D 20.8 12.7 10.6 9.3 7.5 3.7 3.9%" 6.0% 14 
Dd 4.1 24 1.1 5.0 2.8 2.0 17+ 3.28% 2.2" 
s 21 11 1,7 2.3 1.3 1.8 2.2* 8 1.5 
F 16.1 10.9 9.7 8.6 6.6 5.3 2.9%% 3.6%* 8 
F+ 10.0 78 79 5.5 4.3 4.6 ist 1.97 a 
M 2.5 1.7 1.7 3.3 1.8 1.8 1.3 1.3 «= 
FM 2:7 24 2.0 2.3 2.0 1.8 6 1.4 3 
m 9 2 2 1.5 3 4 2.7% = 2.79" 

m--add. m 2.3 5 s 3.4 9 4 3.0%"  3.0** 
b Pi al A ïi 5 Ft 3.90% Ee id pa 
K t g a 3 8 4 6 2.5% 1.2 1.5 
FK 1.6 6 5 8 <8 11 5.0%* 4.6** 4 
Fe 2.3 {1 1.3 2.9 Ll 1.4 2.2% 1.8 7 
c 5 2 à 9 4 3 18t 2.4* 1.0 
c 4 4 8 7 a 1.0 s 2.0% 2.0" 
Sh 5.6 2.5 3.2 5.5 2.1 2.8 3.0%"  2.2* 1.2 
FSh 4.2 2.2 2.8 41 2.0 24 2.5* 1.7 1.1 
ShF 1.4 3 4 2.0 5 7 3.18" 2.8%" 7 
FC 1.7 1.4 7 1.6 14 9 5 gine 2.5" 
CF 1.9 11 8 1.9 1.4 1.2 2.0 2.3% 10 
c 8 ee a 5 es 4 3.0" gt 14 

Sum C 3.9 2.5 1.6 3.1 2.1 1.6 21% 3.gee 2.0" 

A 12.5 10.0 9.2 5.0 6.4 3.9 7+ 30m 6 
H 5.6 3.3 3.2 5.0 2.7 3.0 2.3* 2.4* 1 
P 6.3 5.0 6.0 2.3 14 2.2 2.3% 5 2,2" 

No. of Cont. 

Categories Sot: 5.5 5.4 3.3 1.6 2.4 4.0* 3.5%" 2 
An 2.8 1.5 9 2.5 1.6 11 zs 39 17t 

Sex & Anal. 1.2 4 0 3.1 3 2 2.0* 2.0" es 

Sexes 


+ Significant at the 10% level or less. 
® Significant at the 5% level or less. 
#* Significant at the 1% level or less. 


ically oriented therapy which is practiced by 


the entire staff. 

The fact that each therapist contributed 
some cases to the first group guaranteed that 
he was able to maintain some relationships 
with patients for at least six months. It might 
be anticipated that some therapists may have 
been excluded from the study because hey were 
skilled enough to hold all of their patients and 
therefore could contribute none to the second 
group. Actually, this was not the case. All 
were treating some individuals who, because of 
their primitive defenses or the fear of losing 
their pensions; cpuld probably not have been 
retained in therapy by even the most able of 


practitioners. 


Controls. Table 1 provides a summary of 


variables which, if they were not controlled» 
might have contributed to significant ame 
ences among the three groups. Of all the © 3 
ferences, only the one involving the proportion 
of Negroes is significant at the 5 per cent lag 
of probability. Although the total number 
Negroes is quite small, the percentage m ö 
third group is significantly higher than that © 
the first. However, an independent 
revealed no significant relationships eger- 
race membership within the groups a” i 


entiating Rorschach variables. 


Results and Discussion 


In order to maximize reliability, 
cols were rescored by one individua. p> J co 
to Beck’s criteria for location, F+. +> 
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Table 3 2 
Differences in Percentage Scores of Groups 
p i Mean af GONE SD of Group * GR 
i I Il Ill I-II I-III II-III 
4 7 j = x 20 22 1.3 KE hid 2.4* 
a 5 15 19 14 ZG" 1.4 
10 11 4 9 11 7 4 3.0%" 3.2%% 
S 7 5 9 6 6 10 1.3 1.2 2.4 
F+ 82 89 90 16 15 15 1.8} 21° 4 
F 53 54 54 17 18° 20 2 2 : 
M 8 9 9 10 8 9 5 3 
FM 9 12 11 6 8 12 Lit 9 “4 
a A 1 1 3 2 2 1.6 1.6 . 
m-+add. m 6 2 2 6 4 2 3.1"* 3.6%" 
k 2 1 1 4 2 2 1.3 1.3 
K 3 1 2 2 2 3 ee 
TE 3 3 2 5 4 4 3 do" 
Fe 7 6 A 7 5 7 7 7 
4 i í 1 2 2 4 = ma : 
i 3 3 3 4 4 2.2* * 
Sh 7 12 16 10 10 11 2.0* f 
FSh 13 11 13 8 10 10 $ : E 
ShF 4 1 3 3 2 5 so 8 zio 
aa j 4 4 3 6 6 es oe ia 
oF z = 4 4 6 6 3 è i6 14 
a i ha 8 2 = 2 29% iA is 
eit 2 9 7 8 8 S Aa o 
8,9,10 34 36 28 7 14 9 7 2.9% 2.888 
g E 12 2 1 27 34K 
i E 4 16 1 13 12 = i : 
5 z w a E E 17 ; ™ 13 
No. of Cont. i pi j 
Categories 29 31 31 10 3 9 1.0 9 
a i é 7 6 8 Lt 19 È 
Sex & Anal. 3 1 id 3 1 ta 2.5» 14 


+ Significant at the 10% level or less. 
* Significant at the 5% level or less. 
** Significant at the 1% level or less. 


tent, and Klopfer’s criteria for the determi- 
nants. Using the same system, a second psy- 
chologist then independently scored 20 ran- 
domly selected records of the first group and 
15 of the second. The reliabilities of the scor- 
ing categories for the first group ranged from 
-79 to 1.00, with a mean of .95. For Group II, 
the correlations varied between .41 and 1.00, 
and the mean is .87. Only one coefficient was 
below 80. 

Distributions of the frequencies of both ab- 
solute scores and their percentages were then 
prepared for each of the three experimental 
groups. Means and sigmas were calculated and 
the significances of differences among groups 
tested in terms of critical ratios. Table 2 con- 


tains an analysis of differences among the three 


groups on each of the scoring categories. While 
clinicians do not customarily convert all the 
data into percentage scores before making their 
interpretations, this has been done in the pres: 

ent study in order to determine the differen ‘ 
among the groups that remain significant sie 
the number of responses is controlled. The d a 
are contained in Table 3. C 

Motivation for thera; i 

interpretation of Fig bag a = 
Calden’s [1] comparison of the = R 4 
schach protocols of subjects with high a tbe 
ego-involvement in the test. The ego-inv Ived 
subjects, like Group I in the present ee 
give many responses and obtain high scores in 
D (which usually has a high correlation ith 
R), m, diffusion and shading ranean 
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color. Those low in ego-involvement are sim- 
ilar to Groups II and III in their stereotypy 
as indicated by ‘the large proportion of animal 
responses. In Calden’s opinion, the tendencies 
of the poorly involved subjects to favor the 
easily located animal responses and to avoid 
color, shading, and movement reveal a suppres- 
sive control that bans spontaneity. If this inter- 
pretation is also valid for the subjects of the 
present study who do not remain in therapy, 
it raises the possibility that they may wish to 
avoid changing their behavioral patterns. Such 
a goal might be motivated by diverse factors 
such gs satisfaction with their current person- 
alities, fear that change may lead to psychosis, 
or the desire to preserve the symptoms that 
justify their pensions. Regardless of the under- 
lying motives, the protocols of these patients 
suggest that they react to the projective test in 
a constricted and unrevealing manner, and 
later leave therapy as soon as the possibility 
arises that they may become emotionally in- 
volved. 
This explanation is further supported by 
Schachtel’s clinical observations of resistances 
to the Rorschach test. These may take the 
form of a fear of being “found out,” a defiance 
privately phrased as: “You are not going to get 
anywhere with me,” or an apparent listlessness 
that serves as “the cover for an unconscious 
quite active resistance” [7, p. 432]. In his 
efforts to achieve a noncommittal record the 
patient often limits his total productivity as 
well as the human and human movements re- 
sponses. The record generally becomes stereo- 
typed in content because of the high proportion 
of animal and popular responses. In the present 
study, all the scoring categories listed by 
Schachtel except human movement, the trend 
of which conforms to his observations, differen- 
tiate significantly between the first group and 
either the second or third in the predicted di- 
rections. P . 
Other findings tending to support the inter- 
pretation of resistance are the small number of 
content categories 1n the second and third 
groups and their paucity of sexual ed anal 
references. Finally & TYPE of mee by 
groups who do pot stay 1n ther ne aioe 
by their large F+ Dan a pe eng, to 
Rorschach, a high proportion o ey sign 
that the subjects are “bringing to bear all their 


attention and faculties of self-criticism . - - 
though the answers are extraordinarily stereo- 
typed, showing a poor range of variation” [7; 
p. 57]. 

In summary, the Rorschach records of the 
poor therapeutic risks are characterized by lim- 
ited productivity, few content categories, ster- 
ectypy, a paucity of references to sexual and 
anal topics, little color, and preferences for 
good form responses. If these scoring categories 
are interpreted in the conventional manner, 
they indicate that these patients are probably 
overly deliberate in therapy, do not talk much, 
tend to stick to “safe” subjects when they do 
talk, and censor their emotional reactions. 

Conscious anxiety. An additional interpreta- 
tion of the differential scoring symbols is SU& 
gested by the types of initial complaints. These 
may be divided into three categories, psycho- 
logical, somatic, and a combination of the two 
Examples of the psychological complaints are 
phobia, obsession, compulsion, anxiety, amnesia, 
worry, irritability, nightmare, and depression. 
Among the somatic complaints are gastr! 
pains, diarrhea, constipation, hysterical blind- 
ness, headaches, excessive perspiration, anorex!ay 
breathlessness, and hives. Table 4 lists the fre 
quencies of the different types of symptoms an 
the three groups. 


Table 4 
Initial Complaints 
it II. Bh 
Six months Five sessions ne 
or longer or less theraP 
Somatic 5 16 i 
Psychological 9 9 0 
Combination 18 8 n 
Undetermined 1 a 


x the 
The chi square of 10.6 is significant ate 


5 per cent level of probability. While 4 om 
jority of Group I complain of a combin# 

of psychological and somatic symptom ups 
largest proportions of those in the other a i 
tend to seek help solely for somatic are cond 
The differences between the first 27 3 evel. 


s ii nt 
groups are significant at the 5 per ei for the 


A probability of 6 per cent is obtaine ince the 
comparison of the first and third. third 
differences between the secon chanc® 


groups could have been obtaine 
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they may be considered homogeneous with re- 
spect to type of complaint. 

Fenichel [2] notes that somatic symptoms 
are alternatives to anxiety as derivatives of 
forbidden impulses. Usually, the more the pa- 
tient complains of somatic symptoms, the less 
concerned he is with the problems that create 
them. From these observations, it was deduced 
that patients who tend to somatize to the ex- 
clusion of psychological problems should mani- 
fest fewer signs of anxiety on their Rorschach 
protocols than others. This tends to be the case. 
Of the indicators of anxiety listed by Klopfer 
[3], the two groups who do not remain in 
therapy have significantly less FK, k, Fe, and 
m than the group that remains in therapy. 
Not significant but in the predicted direction 
is the paucity of K in the records of the soma- 


tizing groups. 
A Comparison of Two Experiments 


Judged by the number of significant differ- 
ences, Group I, consisting of those who stayed 
in therapy at least six months, is very different 
from the subjects who refused therapy oT did 
not continue after the fifth interview. On the 
other hand, in terms of the signs of cooperative- 
ness and ability to face anxiety there seems to 
be little difference in the motivations of pa- 
tients in this clinic who see a therapist less 
than six sessions and those who refuse therapy 
outright. This problem of determining an ap- 
propriate cutting point suggests one explana- 
tion of the discrepancy between the present 
results and those of another investigation © 
duration in therapy by Rogers, Knauss, and 
Hammond [5]. These investigators report 4 
lack of significant differences between the pro- 
tocols of subjects who stayed in therapy and 
those who left early. In that design, there were 
two groups: one had four or less therapeutic 
sessions and the other had five or more. Rea- 
sons for the choice of this cutting point are not 
d. It is conceivable that there were no 
significant differences in the motivations for 
therapy or the defenses of those who had four 
therapeutic sessions and those who had five, 

en twenty appointments. This 


six, seven, or even 1 i 
problem was avoided in the present experi- 
ment which utilized extreme groups, those with 


five sessions or less and those who stayed in 
therapy at least six months. Other modifica- 


presente! 
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tions of the design by Rogers, Knauss, and 
Hammond were the controls of factors that 
could reduce the significancesof relationships 
between Rorschach signs and duration of ther- 
apy. These controls included sex, source of 
referral, disorientation, dropping of therapy 
because of reasons beyond the control of the 
patient, and therapist’s skill. Only further 
studies of individual variables can determine 
which aspects of the designs of the two investi- 
gations contributed significantly to the differ- 
ential results. 


Summary 


This is a study of the Rorschach protocols 
of three groups: one remained in therapy ror 
at least six months; another terminated treat- 
ment in less than six sessions against the thera- 
pist’s advice; and a third refused therapy when 
it was recommended. 

Significant differences between the first and 
the other two groups on R, 4%, H, and 
F+%, are interpreted as indicating a greater 
motivation for therapy and resultant coopera- 
tiveness on the part of the former. The stereo- 
typy and lack of productivity of the other 
groups seem to indicate resistance to becoming 
involved in the testing and therapeutic proce- 
dures. Significant differences in the scoring 
categories total C, FK, k, Fc, and m are inter- 
preted as revealing a greater awareness of 
anxiety on the part of the first group in con- 
trast to the suppressive reaction of the two 
who do not remain in therapy. 

The present design is compared with that 
of Rogers, Knauss, and Hammond in order to 
account for differences in results. The blind 
empiricism inherent in investigations of the 
prediction of behavior in therapy from projec- 
tive tests is stressed, and an effort is made to 
summarize some of the principal sources of 


variance that require more detailed investiga- 
tion. 


Received January 8, 1953. 
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The Rorschach as a Measure of Real-Life Stress 
David Berger 


Michigan State College 1 


Despite the present popularity of the Ror- 
schach test as a clinical tool there is no adequate 
body of validating data to confirm the numer- 
ous assumptions underlying the test’s use. The 
growing concern with this deficiency has begun 
to provide impetus for controlled experimenta- 
tion which should result in a better understand- 
ing of the instrument. . 

One of the major problems in the evaluation 
of the test has been to appraise its efficacy in 
measuring anxiety. Much of the work purport- 
ing to treat this problem has been conducted 
under conditions foreign to the clinical applica- 
tion of the test. The list of these efforts in- 
cludes the use of the group Rorschach tech- 
nique as employed by Smith and George [7], 
and the attempts by Williams [8], Eichler [2], 
and Levine, Grassi, and Gerson [4] to employ 
artificial stress to induce anxiety. The results 
obtained in these studies, while suggesting that 
stress influences Rorschach performance, are 
not necessarily pertinent to the usual patient- 
examiner relationship. In a more recent experi- 
ment by Klatskin [3] an acute, real-life, tem- 
porary stress situation was selected to measure 
the influence of anxiety on the test results. In 
contrast to the previous studies her experimen- 
tal setting more closely approximated the test- 
ing situation encountered in clinical practice. 
She was able to substantiate 22 of 26 Rorschach 
indices commonly used in predicting adjust- 
ment, and concluded that the Rorschach was 
sensitive to real-life stress. On the other hand 
the literature contains conflicting evidence sug- 
gesting that the test has questionable validity in 
distinguishing overtly anxious groups from nor- 
mals. For example, Young and Higginbotham 
[10], as well as Wischner, Rotter, and Gill- 
man [9], reported no significant correspond- 
ence between emotional disturbance and certain 
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“anxiety indicators.” These studies have creat- 
ed a general feeling of scepticism about the test. 
Further investigation appears to be necessary 
to resolve this controversy. 


Problem xi 


The present study was designed to ascertain 
the influence of a real-life stress on the Ror- 
schach test. It was concerned with the response 
to stress, as well as with the recovery from 
stress over a period of time. Specifically, two 
questions were asked: Is the Rorschach sensi- 
tive to a real-life stress situation, and if so, in 
what respect does the Rorschach reflect the 
stress? 


Procedure 


Sample. Two matched groups each consisting 
of 40 persons were tested and retested six 
weeks later with the Rorschach.2 The experi- 
mental group was selected from a population 
of persons on the day of their first admission 
to a tuberculosis hospital or a sanatorium.® Pa- 
tients who were in acute medical stress on ad- 
mission were not seen. A range of 18 through 
46 years was imposed to reduce the influence 
of age factors on Rorschach performance [7]. 
The control group was selected exclusively 
from the sanatorium population. Only patients 
whose hospitalization extended at least six con- 
tinuous months were used. They were matched 
individually with the experimental subjects on 
the basis of age, sex, race, marital status, educa- 
tion, and diagnostic classification [6]. The 
= of the matching are presented in Table 

The tests were administered and scored ac- 
cording to the method developed by Beck [1]. 


*Other measures were utilized 
ported in a subsequent article. 

®Herman Kiefer Hospital and Wm. Maybury 
Sanatorium are Wayne County tuberculosis facili- 
ties serving the City of Detroit and its environs 


and will be rẹ- 
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Table 1 


Summated Characteristics of Experimental and 
Control Samples 


Experimental Control 
Population variables 


sample sample 
Sex 
Male 21 21 
Female 19 19 
Race 
White 38 38 
Negro 2 2 
Marital status 
Married 31 32 
Single e 6 6 
Separated 2 2 
Widowed 1 0 
Mean age 31.10 30.98 
Mean education (grade) 10.23 10.30 
Extent of illness 
Minimal findings 4 3 
Moderate findings 26 26 
Far advanced findings 10 11 


Both groups were given the impression that the 
testing procedure was an integral phase of the 
treatment program, but participation on the 
part of the patient was optional. After com- 
pletion of the initial test it was explained to 
each patient that he would be seen again in a 
number of weeks. 

Stress situation. It was assumed that most 

patients entering a tuberculosis hospital per- 
ceive their admission as a threatening experi- 
ence. It seemed reasonable to consider that such 
a situation would generate anxiety and should 
conceivably afford an opportunity to measure 
anxiety in human beings outside the experimen- 
tal laboratory. 

A six-week interval between test and retest 
was used with both groups. It was hoped that 
this interval would allow the newly arrived 
patient ample time to make some adjustment to 
the hospital environment. The expectation was 
that his readjustment would be reflected in the 
change from test to retest. The control 
was employed to control the questionable 
bility of the test. Because of the rela 
stable environment of the sanatorium it was 
felt that the interval between tests would not 
contribute any significant variance to the re- 
test performance of the control population. 


group 
relia- 
tively 


Statistical treatment. The Rorschach results 
were handled in terms of the global configura- 
tion of the performance, as well as by mlyne 
the various atomistic changes. In dealing ee 
the global Rorschach, two judges a ™; 7 
to select the more anxious record from TE e 
records of each experimental subject. “ 
atomistic procedure was carried out by the soe 
parison of differences between the ery 3 
from test to retest in the two groups. The di 
ference in scores between test and retest er 
computed for each subject. Each pti 
subject’s difference score was compared in 
the difference score earned by the matched ye 
ject in the control group. The distribution A 
differences between difference scores was a 
ized to yield ¢ values. McNemar [5] has a 
cussed and justified this method for treat 
the relative shifts in two groups over a ag 2 
of time. The difference between the shigis 5 
the two groups was accepted as a behavioral T 
sponse to stress. 


The atomistic analysis of the Rorschach po 
tocols was based on the absolute ag E 
each scoring category. The traditional obj z 
tion to a raw-score procedure in Rorscha s 
experimentation is that when two population 
produce deviant response totals, any pare 
in the scoring variables is likely to be a se a 
of the differences in the response totals. A 
experimenters have attempted to satisfy i 
criticism by converting into percentages ‘ple 
other statistical derivatives. It is questiona y 
whether these corrections are sound or T°% as 
necessary. The view taken in this research TE 
that response total is in reality the depen on- 
variable, mirroring dynamic changes in per 
ality as demonstrated in the approach, | ean 
minant, and content scoring factors. “The the 
dence points to a differential change w jise 
scoring variables attending a change in resP en 
totals. If the various scores were the depa e 
factors that they have ordinarily been con! ectly 
to be, it should follow that they vary Ur 
with changes in response total. The Pehia 
data, in fact, show many instances in ie 
an increased total response is accompan! eme 
a decrease in certain other scores. It sI as 2 
more parsimonious to view response to iie 
summary statistic dependent upon the T 
der of the scoring profile. 


The Rorschach as a Measure of Real-Life Stress 


Results 


Configurational findings. The problem of 
the reliability of the judgments made on the 
total test performance by the two raters was 
handled by chi square. The two judges were 
in agreement in their evaluation on 33 of 40 
pairs of records, that is, they selected the same 
record as being the more anxious of the two 
records obtained from each experimental sub- 
ject. This result is significantly better than 
chance at the 1 per cent level. 

‘The validity of the judgments was similarly 
subjected to a chi-square test. One judge made 
35 “correct” judgments, i. e., selected the first 
test, out of 40 judgments, while the second 
judge was able to identify “correctly” 36 of the 
40 pairs of records. The chi square for each 
judge was significantly better than chance at 
the 1 per cent level. 

Atomistic findings. A comparison of the 
shifts of the two samples described from test to 
retest for the various Rorschach scores 1s sum- 
marized in Table 2. There were statistically 


Table 2 


Comparison of Change from Test to Retest between 
Experimental and Control Groups 


£3 So 2 
E & 
$ igas fe. Bua 
osni CSTE PSG 
ge seg SERS Bose Od p 
3 Sips SESE RSi 
ag BERG AGRE AREV 
R 7.22" 0.42 6.80 13.19 .01 
F plus % -2.75 742 -10.18 17.74 .001 
# Content 
Categories 1.98 0.18 2.15 3.10 .001 
T/IR 8.85 1.36 -7.49 10.33  .001 
3.58 2.05 -5.62 14.91 -05 
a a 2.65 0.80 1.85 6.25 N.S. 
W -2.28 1.13 3.42 4.19 .001 
D 8.88 0.52 9.40 10.30 .001 
Dd 0.60 0.48 0.12 4.18 N.S. 
M 1.80 -0.02 1.82 3.16 .001 
sum Ë 1.59 -1.12 2.71 3.13 001 
Sum Y -1.08 0.49 -1.56 1.52 .001 
-0.14 0.09 0.22 0.68 .05 
~~ 2.58  -0.50 3.07 2.18 .001 
A -0.20 -0.70 0.50 1.97 N.S. 
Si Reject -15t -2} (not calculated) 
i ined by two-tailed test. 
Note—Significance was, deta penso from first. to 


* A positive Sco: 
second test. 


+ Total difference in number of rejections. 
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significant shifts in 12 of the 16 variables 
assayed. These shifts were presumably the re- 
sult of the anxiety associated with the admis- 
sion situation. In general the direction of the 
shifts as well as the kind of change noted is 
consistent with the “anxiety indicators” com- 
monly used in clinical practice ( Table 2). 
Stress was demonstrated to influence the 
Rorschach in this study by: (a) reducing re- 
sponsivity (R), (&) enhancing reality testing 
(F+9 6), (c) decreasing the breadth of inter- 
est (number of content categories), (d) in- 
creasing reaction time (7'/1R), (e) increasing 
the number of whole comprehensive responses 
(JV), (f) decreasing the number of commen 
detail responses (D), (x) decreasing the 
amount of inner living and creativity (M), 
(h) decreasing the emotional participation 
with the environment (Sum C), (7) increasing 
dysphoric feelings, and feelings of inferiority 
(Sum Y and Sum /’), (j) increasing stereo- 
typy and evasiveness (4%), (&) reducing the 
ability to think in terms of group standards 
(P), and (/) intensifying the need to reject 
environmental stimulation (rejections). 


Discussion 


The response of the experimental popula- 
tion seems to have been influenced markedly 
by the stress of entering a tuberculosis institu- 
tion. With two exceptions (W and F+%) 
all the shifts in Rorschach performance are 
consistent with the alleged indices of anxiety. 
The present study is at variance with previous 
findings in that stress appeared to facilitate the 
perception of whole responses, and increased 
the need to adhere closer to reality. The Ror- 
schach records of the experimental group in the 
first test were then analyzed to determine the 
type of //’ response elicited. A large preponder- 
ance was found to be ready-made, easy wholes. 
They probably represent the most elementary 
type of response, involving a minimum of effort 
for the subjects under stress. 

The present findings support the contention 
that the Rorschach test is a useful instrument 
for measuring anxiety in the type of clinical 
situation studied here. The conflicting view 
that the Rorschach has questionable validity for 
measuring anxiety may stem from a different 
experimental emphasis, utilizing artificial lab- 
oratory stress or diagnostically anxious sub- 
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jects. ‘he present study, as well as the one 
reported by Klatskin [3], suggests that real-life 
stress is an effective medium for measuring the 
effect of anxiety on Rorschach performance. It 
seems reasonable to presume that a real-life 
stress condition results in more pervasive dis- 
comfort than the distress aroused by a noxious 
laboratory stimulus. 

The effectiveness of the Rorschach in this 
investigation contributes to the growing reali- 
zation that it is an instrument sensitive to fluc- 
tuations in the life situation of the subject. 
This realization may serve to emphasize the 
pitfalls involved in interpreting the test clini- 
cally without a thorough awareness of the cur- 
rent environmentai pressures impinging on the 
individual. 

Summary 


Two matched groups of tuberculous pa- 
tients were tested with the Rorschach and re- 
tested six weeks later. One group was seen 
initially on the day of their admission to a 
tuberculosis treatment facility. The second 
group was seen after they had been hospitalized 
for at least six months, The major hypothesis 
was that the initial admission situation would 
provoke a stress reaction recognizable on the 
Rorschach test. 

Other than for minor discrepancies, the re- 
sults obtained were consistent with anxiety 
signs used in clinical practice. It was also dem- 
onstrated that the Rorschach could be used as 
a measure of total personality adjustment in a 
stress situation. Certain cautions were dis- 
cussed in regard to the need to evaluate the im- 


medediate life situation in using the Rorschach 
in personality analysis. 


Received January 15, 1953. 
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The Relation of Rorschach Free Association 
to Inquiry : : 


Robert G. Gibby and Bernard A. Stotsky 
Veterans Administration Mental Hygiene Clinic 
Detroit, Michigan 


. Basic to the use of the Rorschach technique 
in present-day research is the assumption that 
the psychogram is determined by the personal- 
ity of the subject. In the final analysis the value 
of the Rorschach as a scientific instrument is de- 
pendent upon the validity of the objective in- 
dices derived from the test scores. Recently a 
number of studies have focused attention on 
factors other than the personality of the subject 
which determine his Rorschach psychogram. 
The presence of two major sources of such in- 
fluences has been demonstrated in previously 
published studies. These are the “set” of the 
subject [3, 6, 7, 8] and the stimulus value of 
the examiner [2, 3, 4, 5, 9]. A major implica- 
tion of these studies is that obtained scores on 
the Rorschach determinants cannot be regarded 
as corresponding solely to the various areas © 
the subject’s personality structure and its func- 
tioning. 

In order to investigate further the influence 
of the examiner on the Rorschach psychogram, 
Gibby studied the changes which occurred 
from the free association to the final response 
following the inquiry. 

Let us at this point briefly review the gen- 
eral technique of Rorschach administration. It 
be considered as being composed of two 
dependent but nevertheless two clearly differ- 
entiated processes. In the first, the free associa- 
tion, the examiner plays a comparatively passive 
role, with the subject being requested to free 
he Rorschach plates as they are 
him. In the second, the inquiry, 
more active, 


may 


associate to t 
presented to 
the role of the examiner is much 
as the plates are re-presented he conducts 


and eE g : 
clarify” the previously 


an inquiry designed to 


1 From the VA Regional Office, Detroit, Michigan. 
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given free associations of the subject. The con- 
clusions of the previously mentioned research 
on the Rorschach inquiry hax- “=:sed important 
questions which bear on the relationship of the 
free association to the inquiry. These ultimate- 
ly have a bearing upon the presumed validity 
of the entire Rorschach technique. It is the 
purpose of the present study to investigate cer- 
tain aspects of the relationships that exist be- 
tween the Rorschach free association and in- 
quiry. 

There are three major areas of interest in 
the present research. These are: (a) the simi- 
larity of the free-association record to that fol- 
lowing the inquiry, (b) the comparative effect 
of the stimulus value of the examiner on the 
free association and the inquiry, and (c) the 
personality characteristics of the individuals 
who show the greatest and least amount of 
change from free association to inquiry. 

; It is felt that the questions asked in connec- 
tion with these major areas raise issues crucial 
to the utilization of the Rorschach technique in 
contemporary research. For example, does the 
present method of scoring a Rorschach proto- 
col, based as it is upon the combined free as- 
sociation and inquiry, yield the most unbiased 
picture of the subject’s personality? Again, to 
what extent are the Rorschach scores atid in- 
dices, used in many studies to test various hy- 
potheses, contaminated by factors AEE 
not of the subject’s personality but rather m S 
of the examiner’s? It is hoped that the amon 
study will enable the Rorschach phir cata 
be more effectively utilized in assessing the 
personality of the subject, and equally i : 
portant, lead to a reconsideration of meth a 
of analysis of Rorschach data in research ji 

The study will be concerned with the tollo 


3 


ing specific questions: 

1. Are there significant differences between 
the Rorschach determinants produced in the 
free association and those following the in- 
quiry? 

2. Do clinicians differ among themselves in 
the Rorschach determinants produced in the 
free association ? 

3. Is the effect of the stimulus value of the 
clinician on the Rorschach determinants pro- 
duced during the free association greater or 
less than that on the inquiry? 

4. Are there any differences in free-associa- 
tion Rorschach determinants between those in- 
dividuals who -!..2ge the most and those who 
change the least from free association to in- 
quiry? 

Experimental Design 


In order to investigate these hypotheses, an 
experimental group of 240 patients at the 
Veterans Administration Mental Hygiene 
Clinic, Detroit, Michigan was formed. Each 
of these subjects was assigned to a Rorschach 
examiner depending upon the day on which 
he first came to the clinic. No other basis of 
assignment was utilized. Since the clinic has 
no policy of scheduling any particular type of 
patient on any certain day, it was felt that 
this procedure could be regarded as a random 
assignment of subjects to an examiner. Twelve 
<aminers were employed, each testing twenty 
subjects. All examiners had received formal 
training and supervised experience in the ad- 
ministration of the Rorschach, and it was felt 
that from this point of view all were equally 
proficient. They were all either Veterans Ad- 
ministration clinical psychology staff members 
or advanced trainees assigned to the Detroit 
Mental Hygiene Clinic. The Rorschachs were 
given routinely, the inquiry being structured 
by the examiner in his usual manner. None of 
the examiners had any knowledge or awareness 
that the present study was to be conducted. 
The Rorschach determinants investigated 
were: F, M, FC, CF, C, FY, YF, Y, and V. 
Beck's [1] scoring techniques were in general 
employed for scoring these determinants. The 
free-association responses were first scored for 
each record. Next, the combined free-associa~ 
tion and inquiry responses were scored. Each 
response was thus scored twice, each scoring 
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being done independently. Reliability of the 
scoring was then determined. For thig purpose 
27 records were randomly selected, and they 
were then rescored by a second person who had 
been previously trained in the scoring tech- 
niques utilized in the study. Criteria for scor- 
ing of responses were determined in advance. 
For example, it was decided that all responses 
such as “humans pointing” should be scored 
as M. 

In order to control the variability possibly 
introduced by R, the number of responses for 
cach determinant in the free-association scoring 
of cach record was converted to a percentage. 
This was done by dividing the number of re- 
sponses for each of the determinants by the 
total number of responses. The same procedure 
was followed for the inquiry scorings. ‘Thus 


two percentages were calculated for cach de- 
terminant in each record — the first being the 
as- 


percentage of the determinant in the free 
sociation and the second being the percentage 
of that determinant following the inquiry- In 
order to treat the data more adequately St% 
tistically, these were then translated into at 
sine units. It was thus possible to analyze the 
data in terms of both the absolute and the per- 
centage scores. The appropriate statistica 
manipulations were then performed in light 0 
the particular hypothesis to be tested. 


Results 


The first concern was reliability of ane 
Pearson product-moment correlations betwe 


r- 
two scorers were computed for each dete 
Table 1 pee” 
Comparison of Means of Rorschach Determin’ 
in Free Association and Inquiry 
zeen 
Det . seese lute score Are-sine eee A 
etermi- z inavi 
nant aif. CR cr _ andira 
7 
F -4.79 17.10%  26.2** rt 
M -30 4.29** 7.0** ‘21 
FY 2.14 13.37%" © 21.4** 4 
YF 29 oger m n 
Y 02 17 58 
FC 96 14.89" 3 
CF 90 13.1 ‘92 
¢ wie 
y 19 4,00) 
R i — 
+N = 240. 
level. 


** Significant beyond the 1% 
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minant. This was done for both free associa- 
tion and inquiry. The mean reliability for 
free-association scoring of the experimental de- 
terminants was .91, and for inquiry .92. 

In order to test the first hypothesis in re- 
gard to differences between free association 
and inquiry, critical ratios were calculated on 
both the difference in arc-sines and the differ- 
ence in absolute scores for each determinant 
from free association to inquiry. These data 
are presented in Table 1. It may be sum- 
marized from this table that: 

1. The following Rorschach determinants 
change significantly from free association to the 
inquiry: FY, YF, FC, CF, F, M, and V. No 
significant change occurs on Y or C. These 
changes occur when the determinants are com- 
pared on both percentage and absolute scores. 

2. The determinants may be differentially 
ordered as to the amount of change shown 
from free association to inquiry. F shows the 
greatest change, followed by F Y. Next come 
FC and CF, followed in order by M, YF, V, 
and Y. F decreases from free association to 
inquiry while all the other determinants show 


an increase. f 
3. The correlations between the determi- 
nants from free association to inquiry also may 
be differentially ordered. Those showing 4 
high degree of relationship are F, M, and C. 
Those showing a moderate relationship are Y, 
CF, V, FC, and YF. There is comparatively 
very little correlation between the number of 
FY responses on the free association and those 
following inquiry. 
In order to explore the second and third 
hypotheses in regard to the variance attribu- 


table to the stimulus value of the examiner, 


an analysis of variance was done between the 
for each of the Ror- 


distributions of arc-sines 
schach determinants on the free association. An 
earlier study [5] reported the differences be- 
tween examiners following inquiry. The re- 
sults of these analyses are: 

1. On the free association there are no sig- 
nificant differences between examiners for any 
of the Rorschach determinants. 

2. On the inquiry there are significant dif- 
ferences beyond the 5% level in the cases of 
the FY and Y determinants. 

A prior study of Gibby [4] showed that ex- 
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aminers differed significantly among themselves 
in changes from free association to inquiry. 
‘That there is no difference between examiners 
on the free association and that there is such 
a difference on the inquiry is demonstrated in 
the present study. Therefore, the free associa- 
tion appears to be free of examiner influence 
and whatever examiner influence occurs on the 
Rorschach is attributable to the inquiry. 

The third question was concerned with the 
personality characteristics of those individuals 
who changed the most from free association to 
inquiry as opposed to those who changed the 
least. In order to investigate this, distributions 
were first made of the changes by subjects in 
F from free association to inquiry in arc-sine 
units. Changes in F reflect the summation of 
the changes in all other variables since the 
change in every instance was from F in the 
free association to another determinant in the 
inquiry. The data were then analyzed in two 
ways: (a) with regard to examiner, and (b) 
without regard to the examiner. 

It has been shown that examiners differ 
among themselves in the amount of change 
produced from free association to inquiry. It 
is possible that those examiners producing the 
least change had within their group of sub- 
jects individuals who were capable of change, 
but due to the influence of the examiner 
showed comparatively little change. Therefore 
the six examiners producing the greatest 
amount of change were utilized. For each ex- 
aminer the five individuals showing the great- 
est amount of change and the five individuals 
showing the least amount of change in F from 
free association to inquiry were selected and 
combined to form two groups. The critical 
ratios between these were calculated for each 
of the Rorschach determinants in the free as- 
sociation. It was found that those individuals 
who changed the most from free association to 
inquiry showed a significantly higher number 
of F and a significantly lower number of M 
and FC responses in the free association. 

In addition a new sample was chosen with- 
out respect to examiner. The 40 individuals 
showing the most change were compared with 
the 40 showing the least change. Here also 
those individuals changing the most from free 
association to inquiry showed a significantly 
higher number of F and a significantly lower 
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number of M and FC responses in the free 
association. These data are presented in Table 


2a 
Table 2 
Comparison of Free-Association Determinants of 
Groups Changing Most and Least from Free 
Association to Inquiry 


Critical ratio ł 


Examiner Examiner 
Variable uncontrolled controlled 
(N = 80) (N = 60) 
F 2.5% 5.6* 
M 4.0* 4.7* 
FY 6 5 
YF 1.8 1.0 
FC =>:2.6° 2:1” 
CF Lt 1.6 
C 5 1.9 
y 3 1.2 


* Significant beyond the 5% level. 
+ Critical ratios are based upon arc-sine differ- 
ences. 


Discussion 


Like other psychological techniques the Ror- 
schach is utilized in a dual capacity. In one it 
plays the role of a clinical instrument, being 
used to explore the various aspects of the per- 
sonality of an individual patient. Here the 
contribution of the technique may be con- 
sidered as being directly dependent upon the 
skill of the clinician, and the administration 
and interpretation of the Rorschach become 
in practice highly subjective processes. The 
inquiry itself varies both with the examiner 
and with the patient and may assume, for ex- 
ample, a directive or nondirective character de- 
pending upon the problem which the clinician 
is called upon to solve. Many clinicians say 
when this possibility is discussed with them, 
“Yes, I pushed hard here for shading (or 
movement or color) but I recognized this and 
took it into account when I interpreted the 
d.” This is perhaps as it should be since 
in order to deal with his exceed- 


ingly complex referral problems, must call up- 
on all of his individual skills and clinical in- 


sights. Although it is beyond the scope of the 


present study, the guestion might well be raised 


as to how many of these insights are valid. 
How many rest upon what may be an unevalu- 
ated structure based upon personal experience 
rather than upon adequately investigated facts? 


recor 
the clinician, 
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In its second role the Rorschach is becoming 
more extensively used as an experimental in- 
strument, being applied to a wider range of 
problems. Here it is not the subjective im- 
pressions obtained by the clinicians which have 
been utilized so much as the scores which are 
recorded for the various Rorschach location, 
determinant, and content variables. It is in 
this aspect of the utilization of the Rorschach 
that we are most interested at the present time. 


Since the research applications of the Ror- 
schach deal essentially with scores, then We 
must of necessity be concerned with how these 
scores are obtained. The present study demon- 
strates that the examiner introduces a signi" 
cant variance into the obtained scores which, 
as one illustration of the possible distort!o™ 
might tend to make nosological groups ON” 
verge in their mean final Rorschach scores 
on various determinants. It may be assume 
that experimental results containing variance 
introduced by the examiner would affect the 
theoretical constructs based upon the evidence. 
For example, studies based upon the Rorschac 
data collected by a single examiner woul 
contaminated by the particular personality 
characteristics of that examiner. It has bee? 
shown that examiners differ among themselves 
in regard to their effect upon the subject: 
Studies based upon the Rorschach data collect- 
ed by several examiners might be suspect OF 
the same reason. In addition there is the 
further complicating factor of the differenti? 
reactions of individuals to the examiners- 
these must be controlled before the Rorschac 
data can be most properly utilized in researc? 

The present study has demonstrated that e 
aminer influence occurs on the Rorschach dur- 
ing the inquiry, and that its effect on the fre 
association is minimal. It is therefore felt that 
attention should be given to the lop ity 
of techniques designed to reduce the poss! 1 
of examiner influence. One suc 


might be to give the subject the usua test, 
tions prior to the administration ° he giv 
but in addition to ask at that time that ai ex- 


also the location and determinants. ~ struc- 
ample, he could be given the following 1 


tions: “Tell me where you see it, A merits 
suggests it to you.” It is felt that the 


A A : jon and ex 
of this technique warrant consideration 4 
perimental exploration. 
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It is not the purpose of this discussion to 
belittle the importance of the inquiry insofar 
as the results are utilized by the clinician in 
his handling of the problems presented by the 
individual patient. The verbalizations and con- 
tent produced are often clinically rich in that 
they offer clues to the underlying dynamic 
processes with which the clinician is concerned. 
Rather, it is the fact that the complexities of 
the interaction of the subject and the examiner 
during the inquiry result in scores which are 
not only properties of the personality of the 
subject but also those of the examiner. Be- 
yond the implications of this being a con- 
taminatory factor in research applications, the 
findings have additional implications for the 
clinical interpretation of the Rorschach. The 
inquiry may be viewed not only as an interac- 
tion process between the subject and the ex- 
aminer, but as a situation in which a second 
distinct perceptual process is experienced by 
the subject during the re-presentation of the 
Rorschach plates. This might be considered in 
itself as an additional unique perceptual ex- 
perience. Systematic studies of the changes 
which occur on this re-presentation would be 
valuable since the changes from free associa- 
tion to inquiry within a given record might 
have considerable clinical significance. The 
findings of the present study offer some clues 
as to this process of change. 


It was found that those individuals who 
changed the least from free association to final 
response following inquiry had a significantly 
higher amount of M and FC and lower 
number of F responses in their free-association 
records than did those who changed the most. 
‘This held true regardless of whether or not 
the examiner influence was controlled. The 
higher M suggests that those individuals with 
the least changes are possibly more comfortable 
in the interpersonal situation, relating more 
adequately to the examiner. They are less 
ready to interpret the situation as one of threat 
and consequently change relatively little in the 
shading determinants. Shading on the inquiry 
in the previous study [4] was shown to be 
related to the overt hostility of the examiner. 
The higher FC may be presumed to indicate 
that they relate better to external environ- 
mental situations and that their emotional re- 


actions are more stable. The higher “JZ and 
FC scores suggest that those individuals who 
in the Rorschach test situation change the 
least from free association to inquiry may be 
characterized as more rich and mature person- 
alities. They possess a comparatively higher 
degree of psychic energy leading to a more 
complete and fuller initial response to the Ror- 
schach blots. This is again suggested by the 
findings in regard to F. The persons changing 
the most had a significantly higher number of 
F responses on free association than did those 
who changed the least, being more constricted 
and showing greater affective suppression. 
Finally, there is another crucial aspect of the 
relationship of the free aSsuciation to the in- 
quiry which has not been investigated. The 
question now arises as to their relative validity 
as measures of the personality characteristics 
of the individual. Which gives the more ac- 
curate picture of the person? Additional 
studies are planned to investigate this area. 


Summary 


1. Three areas of the relationship of the 
Rorschach free association and inquiry were in- 
vestigated: (a) their similarity, (6) the com- 
parative effect of the stimulus value of the ex- 
aminer on each, and (c) the relationship of the 
personality characteristics of the subject to 
changes from free association to inquiry. 

2. The subjects were 240 patients at the 
Detroit Mental Hygiene Clinic tested by 12 
examiners, each testing 20 patients. 

3. It was concluded that (a) the free-as- 
sociation record significantly differs from that 
of the inquiry, (4) the free association is rela- 
tively free of examiner influence and virtually 
all influences which occur are attributable to 
the inquiry, (c) the personality characteristics 
of those individuals changing the most differ 
significantly from those changing the least. 

4, The implications of the findings for both 
the clinical and research utilization of the 
Rorschach were discussed. Of particular im- 
portance was the need for re-evaluation of past 
studies in light of the differential examiner in- 
fluences on the inquiry. The need for studies 
of the relative validity of the free association 
and inquiry was stressed. 
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The present investigation has for its pur- 
pose the analysis of the Rorschach records of 
45 cases of involutional melancholia. Relative- 
ly little has been published about the Rorschach 
patterns for this type of mental abnormality. 
What is available is about depressive states 
generally, without much attempt to differen- 
tiate a specific pattern for involutionals. The 
evidence of the present study indicates that the 
typical involutional in this group is quite dis- 
tinct from the individual presented in the Ror- 
schach literature on depressed states under 
which involutional melancholia has been hither- 
to rather indiscriminately subsumed. These 
data then should represent an aid in a more 
adequate differential diagnosis. 

The involutional psychosis is characterized 
by depressions occurring in middle and later 
life without evidence of any organically deter- 
mined intellectual defects. The symptoms 1n- 
clude agitation, uneasiness, unreality feelings, 
nihilistic delusions, anxiety, depression, insom- 
nia, self-condemnation, and hypochondriacal 
elements. There is no history of previous at- 
tacks [5]. There are two types of involutional 
melancholia, the paranoid type in which there 
are delusions of persecution without a history 
of paranoid behavior, and the depressive type 
with typical signs of profound melancholia. 
While genetic and endocrine factors, particu- 
larly the latter, are important etiological fac- 
tors, the social factors must not be neglected. 
Among the latter the factors of status and 
personal adequacy are of particular importance 
[3]. In involutional melancholia the self-con- 
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1The supP 


cept is thought to undergo radical changes as 
a result of increasing age, menopausal changes, 
appearance changes, changes in energy and am- 
bition, family disintegratior, vivaness, especially 
in relation to death, and a concern with the 
next life. For these people, the future is said to 
be essentially threatening and negative rather 
than stimulating and challenging. 

The Rorschach data collated from previous 
studies leave something to be desired. As pre- 
viously indicated most of the studies, specifi- 
cally those of Rorschach [10], Guirdham [4] 
Varvel [11], Beck [1], Bochner and Halnern 
[2], Klopfer and Kelley [8], give factual in- 
formation with regard to the general category 
of depressives but not adequately for involu- 
tionals. Rapaport [9], Johnson and Sherman 
[6], and particularly Kendig and Vernier [7] 
deal specifically with the involutional’s re- 
sponse to the Rorschach. Of these studies that 
by Kendig and Vernier is easily the most sys- 
tematic, carefully designed, and diagnosticall 
useful that has appeared to date. In peat | 
there is little system in the way the facts are 
reported, in what is reported, and how-the 
findings are worded. Almost all the investiga- 
tors present their findings in descriptive and 
relative terms. Their data are virtually u 
amenable to exact statistical evaluation a h 
less cross-validation. An attempt will be Si 
however to summarize briefly the tects. th i 
are available from these studies. 7 


Rorschach [10] himself doe: i 
number of cases, Guirdham [4] pa Tél i 
pressives and 17 agitated depressives Varvel 
{11] has 34 depressives and 14 setata depres- 
sives, Beck [1], Bochner and Halpern [2] 
Klopfer and Kelley [8], and Johnron and 
Sherman [6] do not give the number of cases 
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upon which their generalizations are based. 
Rapaport [9] used 7 cases, and Kendig and 
Vernier [7] so far have provided data on 25 
depressives and 25 paranoid involutionals. 
With regard to the number of responses, 
three of these studies [2, 8, 11] give no re- 
sults, the remainder [1, 4, 6, 10] with one 
possible exception [9] indicate that the Ror- 
schach responsiveness is diminished. Reaction 
time of these subjects is unknown from three 
studies [4, 9, 11], whereas the remainder indi- 
cate that it is prolonged without being much 
more specific. Bochner and Halpern [2] and 
Klopfer and Kelley [8] indicate that it will 
generally be sivtv seconds or longer. In general 
one can say that all the studies are in substan- 
tial agreement that the F% is considerably 
increased over what js normally expected. In 
several instances F% is over 80. The number 
of AZ responses again finds rather general 
agreement among the investigators in that there 
is a reduced production in contrast with the 
normal. M is either absent or very low in pa- 
tients of this type, although some exceptions 
are found [6, 8, 10]. All the studies likewise 
generally agree that the C response on the 
Rorschach is markedly reduced or absent. Such 
phrases as “few or none,” and “essential ab- 
sence of C,” characterize the findings. Two 
studies [2, 8] speak of an increased GC’ in 
place of the more usual C scores. The four 
studies that indicate any findings about light 
and shading responses show that they are us- 
ually few in relation to what might normally 
be expected [1, 2, 4, 11]. The WF factor in the 
test is generally decreased for this type of pa- 
tient [1, 2, 6, 8, 11], although at least four 
studies suggest no decrease or an actual increase 
of W [4, 8, 9, 10]. This increase in JV” may 
however be for the neurotic type of depression 
rather than for the psychotic type. The find- 
ings with respect to the relations between H 
and Hd are unanimous, where present, in find- 
ing an increase of Hd over H [1, 4, 8, 10, 11]. 
It is also generally agreed by these investiga- 
tors that the 4% is increased [1, 2, 4, 8, 10, 
11]. Two studies find a decrease in A%, but 
these two are specifically for involutional pa- 
tients [6, 9]. Three studies report on the orig- 
inal res; onse [4, 8, 10]. In all instances they 
are low or absent, and if present they tend to 
be bizarre [6]. The findings with regard to 
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the popular responses are inconsistent. Six of 
the eight studies report such data, of which two 
[4+, 8] suggest an increase and three [6, 9, 
11] suggest a decrease. 2 oi 

ie preliminary findings of the Kendig and 
Vernier study warrant special comment. They 
found that the typical depressive pattern was 
absent in their cases. Instead their research 
showed an organic pattern, but was distin- 
guished from the usual organic profile by ee 
adequate form level, adequate populars, an 
an average total number of responses above 
fifteen. They likewise report a prolonged eee 
tion time. Their cases show an increased # 
and Fé, a decreased M, D, and O respon- 
siveness, and few shading responses. m 

In a relatively recent study by Young [12] 
13 cases of involutional melancholia were given 
the Rorschach. He finds a distinct pattern 
for these cases differing from other types ° 
mental abnormality. Response average Was 
low, V was increased, M reduced or absent, 
C was absent or variable, and animal and ane 
tomical responses predominated. Qualitative 
factors were stressed. The more important 
ones included: depreciatory remarks, stereo- 
typy, paucity and rigidity of thought, and 1r- 
relevant responses. 

It seems clear from a brief review of the 
literature that most of the evidence that !S 
available on the quantitative structuring of t ý 
Rorschach in this area has to do with the ea 
cords of depressives, both neurotic and psyc a 
tic. Since one of the basic elements in ores 
lutional picture is that of depression, 1t a 
generally been assumed that the depressive 
agnostic pattern revealed in the literature Sr 
be used to make a correct diagnosis of Ean 
tional psychosis. If the depressive in gee 
the key element underlying these ht 
tal illnesses presumably the men 
sponses would be affected in a subs 
similar way. 


re- 


ach 
wn tially 


Subjects 


The subjects used in this study ie 
carefully diagnosed female involttig n enig 
chotics admitted to a state hospital. ‘aia 
two of the cases were diagnosed as anes 
psychosis proper, and 23 cases wa P The 
as involutional psychosis, ee ae with 
mean age of the subjects was 49. ae 
a standard deviation of 4.4. The mea 
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of years of education was 8.4 with a standard 
deviation of 4+.8 years. The mean intelligence 
quotient for 28 of these patients, taken from 
the Wechsler-Bellevue, was 92.3. There were 
no statistically significant differences between 
the mean age and the mean years of education 
of the two diagnostic subgroups. Thirty-five of 
the subjects were housewives and 37 of them 
were married. All the patients were oriented 
in the usual psychiatric sense. Thirty-four of 
the patients had accelerated motor behavior, 9 
were normal in this respect, and 3 were re- 
tarded. 
Discussion of Results 


The present data indicate that both the 
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quantitative and the qualitative picture pro- 
vided by these involutional cases is not even 
remotely similar to the usua! depressive pic- 
ture, whether neurotic or psychotic. Setting up 
involutional psychosis as a separate disease en- 
tity, as is argued by most psychiatric authorities, 
finds considerable support in the data of the 
present involutional group. An examination of 
Table 1 presents some of the facts that can be 
used in support of such a contention. Certain 
of these findings are worth emphasizing. 


The involutionals certainly do not produce 
the number of achromatic responses in propor- 
tion to the chromatic ones which are generally 
to be expected in a depressed patient. For the 


Table 1 


Rorschach Test Characteristics of a Grou 
with Contrasted Subdiagnosti 


p of Forty-five Cases of Involutional Melancholia 
c Groupings of Paranoid and Depressed Cases 


anoid Depressed Total 
Score Ta 23) (N = 22) (N=45) x2 * 
Mean SD Mean SD Mean SD Med. Md.D 
Rate 5 9.23 3.73 10.08 3.74 10.20 3.02 01 
pom m Pig Pry 442.0 152.7 434.0 163.8 412.0 135.2 02 
Time per R 26 1770 5040 2270 4470 21.00 40.20 1651 20 
An Eg ae 1635 9.80 16.55 1045 1645 1010 1360 751 22 
Av. reac. time M ` 
` 5.65 9415 14.80 8.60 13.20 6.52 1.07 
E cards ee a eae aoe Tie ove ate A u 
D+d 5.39 2.90 4.32 293 4.87 2.96 4.00 9.53 23 
Dd +S 0.17 0.37 0.27 0.67 0.22 0.56 0.00 0.22 .10 
F 7.22 3.11 5.59 2.66 6.42 3.01 6.33 2.39 2.53 
F% 69.30 21.20 60.90 22.10 65.30 22.10 64.50 16.20 1.81 
a 0.17 0.37 0.14 0.35 0.16 0.36 0.00 0.16 01 
a 030035 06} 0.37 OAT 093 0.00 0.47 i58 
a 0.17 0.48 0.05 0.22 0.11 0.39 0.00 0.11 .23 
7 0.39 0.92 0.23 0.42 0.31 0.72 0.00 0.31 08 
He 1.00 1.24 1.17 1.56 1.09 1.43 0.00 1.09 02 
or 0.09 0.28 0.14 0.35 0.11 0.32 0.00 0.11 .002 
4 1.33 1.35 1.53 1.76 142 1.57 1.00 2.65 01 
ogy 0.52 0.65 0.64 0.78 0.58 0.71 0.00 0.84 02 
oi ie 0.56 0.72 0.86 1417 0.71 0.98 0.00 0.71 02 
a osz 204 032 0.76 042 154 000 253 of 
uma 42.30 22.45 61.80 21.98 51.80 24.27 52.70 18.06 2.84 
A 2.04 1.12 2.73 1417 2.38 1.20 2.46 0.75 20 
Z, 0.70 1.08 0.05 0.22 0.33 0.87 0.00 0.38 5.92 
oe, 8, 9, 10/R 29.90 6.00 31.41 7.96 30.82 7.00 30.78 5.85 1.79 
E a 70% 64% 67% di 
a, 65% si =- 2 
p Ad 74% 86% 80% or 
ae oF = 91% 86% 89% “603 


* With 1 df, x? must reac 


h 3.84 to be significant at .05 level. 
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present group the sum of the chromatic re- 
sponses was actually larger thar. the sum of 
the achromatic responses. The emotional re- 
sponsiveness of the involutionals is indicated 
further in the predominance of the CF and C 
over the FC responses. There were no M re- 
sponses in the group of any consequence. Of 
the total of 45 cases only 6 had any M re- 
sponses, and each of these had only one M. 
The movement response is obviously not pro- 
duced by the involutionals. It may be as Ror- 
schach suggests that people with accelerated 
motility produce few M and more color re- 
sponses. These three factors then characterize 
this group. The average F% is high in this 
group but it is atso considerably lower than 
has been reported, without data, in much of 
the literature. The responses that generally 
accounted for the lowered F% were the Fc, 
c, and CF responses. Of additional consider- 
able importance in support of the rejection of 
the usual depressive profile for the involution- 
als is the almost total absence of the F-+ re- 
sponse. Form responses of involutionals are 
characteristically mediocre or poor. The pro- 
portion of W responses is approximately the 
same as for other types of “depressed” patients, 
perhaps slightly lower. Response and reaction 
times of the involutionals however tend to be 
within the normal range rather than exagger- 
ated as in depressives. The involutionals char- 
acteristically give quick responses even though 
there is considerable clinical anguish and des- 
pair. On the other hand it often took literally 
hours to get these patients to continue respond- 
ing between certain cards. It is also possible to 
say in the light of the evidence that these pa- 
tients are not typically stereotyped as has been 
reported for other types of depressives. This 
can be determined from the type and from the 
variety of the content. 

The findings with respect to the proportion 
of the +A responses to the Hd+4d reponses 
was clear-cut. In almost 100 per cent of the 
cases the sum of the H+ responses was equal 
to or exceeded one-half the sum of the Hd+Ad 
responses. It seems clear that as far as the in- 
volutional records go, the human and animal 
part responses are-not excessively proportionate 
to the hyman and animal whole reponses. Pop- 
ular responses were also considerably lower 
than expected for the depressives. The average 


P was slightly over two rather than the ex- 
pected five. However the number of additional 
populars was high. Here the patient gave the 
“popular” response without the complete detail 
required for popular scoring. This neglect in 
“completing” properly the popular response, 
when given, and the unusual verbalizations of- 
ten associated with the populars, was character- 
istic of the individual P response. 


Despite readily observable intense clinical 
anxiety in the majority of these patients, the 
appearance of K, k, and m responses was wd 
tremely rare. The mean frequency of all suc 
responses was less than one-half a response 
The anxiety shown in these protocols manifests 
itself in ways different from the anxiety ka 
of the typical psychoneurotic [4]. The fF 
ferences in the quantitative responses to 
chromatic and achromatic cards are likewise no 
characteristic of the depressive picture. For the 
present data the increased reaction time Lo 
achromatic cards over the chromatic cards 1 
not a typical indicator of depression. The PoP: 
ular responses to chromatic cards do not excee 
the popular responses to achromatic cards- 
number of rejections to achromatic cards ges 
not exceed the number of responses to t e 
achromatic ones. 


It is worth noting that, statistically, 
are no differences of any consequence be 
the paranoid and the depressive subgroups a 
the total involutional sample. This is true te 
all the test factors susceptible to such Orda 
tative analysis. Using chi square, and applyt ó 
the Yates correction in all instances, 3° E 
basis for the analysis, none of the differen E 
approach an acceptable probability levet- aa 
O% responses with a chi square of 5.92 << is 
a p of .01 with one degree of freedom- tatis- 
reasonably questionable whether this one $ af? 
tically significant difference, among 50 al 
others, has any importance. For all sor a 
purposes, and from the quantitative oe tota 
view, the subgroups do not differ, and t the use 
group is homogeneous. In addition since might 
of a mean and the standard deviatiod -heir 
in relation to the assumptions unded 
use, give questionable results, the E c all the 
median deviations were calculated fo nce for 
data. No differences of any pase tent” 
these two different measures of a data. 
ency and dispersion were found for 


there 
tween 


an 
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This is clear from the last column of Table 1 
where the comparable statistics are given. 


Qualitative Analysis 


An analysis was made of the 45 involutional 
protocols to determine the nature and the ex- 
tent of the qualitative factors that character- 
ized the group. It was thought that these might 
be even more useful than the more customary 
quantitative factors used in arriving at a dif- 
ferential diagnosis. The approach was induc- 
tive and empirical. The records were read care- 
fully by the investigators and fourteen factors 
were isolated. Eight of these factors had use- 
fully large loadings. 

The use of words and phrases indicating un- 
certainty and the need for reassurance charac- 
terized the entire group. Such expressions as 
‘Gs it right or wrong,” “maybe I said it 
wrong,” “I want to say the right thing,” all 
illustrate a process of thought and feeling that 
reappeared regularly and consistently. Among 
the paranoid subgroup such expressions ap- 
peared in the records of 61 per cent of that 
group, with an average of 4.3 repetitions in the 
records where it appeared. Fifty per cent of 
the depressives had an average of 2.2 such 
phrases in those protocols. Thus over one-half 
of the total group of involutionals used such 
expressions on the average of three and one- 
half times per record. 

The total number of rejections of the cards 
represents an important aspect of the records 
qualitatively. Sixty-one per cent of the para- 
noids had a total of 32 rejections for an aver- 
age of 2.3 rejections per person doing any Te- 
jecting. Fifty-nine per cent of the depressives 
had a total of 46 rejections, or an average of 
3.5 rejections for each patient in this group. 
Rejection rates are thus approximately the 
same for both subgroups and are found in 60 
per cent of the cases of involutionals. The most 
frequently rejected cards are six, seven, and 
nine. The least frequently rejected cards are 
one, five, and eight. All cards showed some re- 
jections. The order of frequency of rejections 
ds six, nine, seven, ten, three, four, 
one, and five. 

e self-reference characterizes the 
group. Several examples of this type of ref- 
erence will help to explain what is meant 
by this term. The patients said such 


was: Car 
two, eight, 
Considerabl 
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things as “am I crazy,” “can’t my husband 
take me out,” “I don’t want to die,” “you are 
leading me to the gallows.” There were nu- 
merous hypochondriacal complaints. Of a total 
of 23 paranoids 13 or 57 per cent used such 
forms of self-reference. It was used 2.6 times 
on the average for this group. The depressive 
subgroup of 22 patients showed 45 per cent us- 
ing such self-reference for an average of 3.1 
times. One-half of the total group of involu- 
tionals used self-reference a total of 65 times 
for an average use of 2.8 times for the users. 

Sexually toned responses were frequently 
used, especially among the paranoid patients. 
Typically the sex response was evasive and 
general. Examples are: “newborn,” “below a 
woman’s stomach,” or “this one makes me 
hot.” Some responses were more specifically 
sexual, such as “breast” and “vagina.” Such 
responses occur more than twice as frequently 
among the paranoids than they do among the 
depressive involutionals. Sex responses occurred 
in 57 per cent of the paranoid protocols for an 
average of 3.9 appearances. Only 23 per cent 
of the depressives gave such responses for an 
average of 2.4 times in the protocols where 
they were found. 

Perseveration was markedly apparent in the 
protocols of these involutionals. Eleven out of 
23 paranoids, or 48 per cent, showed persevera- 
tion 42 times, or 3.8 times on the average for 
the persons represented. The involutional de- 
pressed group showed 41 per cent perseverating 
for an average of 2.7 times per protocol. Thus 
approximately one-half of the total group 
showed perseveration on the average of 3.3 
times in these records. 

There are two types of perseveration that 
may logically be distinguished in these records. 
One type of perseveration is the usual kind 
which appears in the presence of the F— re- 
sponse. The other type usually appears three 
or more times successively but is not accom- 
panied by the F—. This latter type is deci- 
dedly more frequent and typical here. Of a 
total of 20 out of 45 cases that showed any 
perseveration, the latter type was found in 70 
per cent of the cases. Such things as body 
flower, Xray, bones, animals, just colors, are 
typically perseverated, 

The characteristic perseveration seen here 
reflects a sort of mental or associational “‘sticki- 
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ness” without impairment of intellectual con- 
trol. This may be a temporary ‘imitation on 
perceptual variability, or an inability, because 
of intense anxiety, to depart easily from the 
quickly seen or accepted. It is a perseveration 
of fear, of avoidance, of vacuity, rather than 
one of dissociation or deterioration. 

Many of the women had the practice of 
ascribing undesirable characteristics to the 
blots. They used such words as, “mean, evil, 
frightful, having horns, like the devil, unclean, 
and threatening.” In the paranoid group such 
expressions occurred 18 times in 5 protocols, 
or in 22 per cent of the cases. In this group 
the average occurrence was 3.6 times. The de- 
pressives showed tizis in twice as many, or in 
45 per cent of the protocols, the average occur- 
rence in these records being 1.6 times. For the 
total group this type of response occurred in 
one-third of the cases with an average frequen- 
cy of 2.3 times. 

F— responses were infrequently found in 
these involutional protocols. Only ten out of a 
total of 45 protocols showed such a response. 
Of this small group 90 per cent are found 
among the paranoids. The records that have 
this type of response show it on the average of 
3.2 times per protocol. 

Paranoid references are seen in one-half of 
the paranoid group and not at all in the de- 
pressive group. This is one qualitative feature 
that definitely distinguishes the two groups, as 
might be expected. The 52 per cent of the para- 
noid subgroup who made such responses gave 
them on the average of 2.3 times per protocol. 

Certain facts stand out in evaluating the 
qualitative response characteristics of this invo- 

lutional group. In the first place the sub- 
classification of the group into paranoids and 
depressives reveals certain important differ- 
ences between them, as well as important sim- 
ilarities. Presumably these differences should 
have some value for differential diagnosis with- 
in the group. The subgroups are homogeneous 
with respect to expressions of uncertainty, need 
for reassurance, self-reference, perseveration, 
and rejections. Depressives ascribe undesirable 
characteristics move frequently, while sex, par- 
anoid, and F— responses occur more often 
- among ihe paranoid involutionals. 


Frank J. Kobler and Agnes Stiel 


Summary 


The protocols of 45 involutional melancho- 
lics were analyzed quantitatively and qualita- 
tively. The findings of this analysis were con- 
trasted with those of similar studies to deter- 
mine differences and reliable diagnostic indica- 
tions. The results indicate a pattern in involu- 
tionals consistently dissimilar from the usual 
depressive picture, whether neurotic or psycho- 
tic. Involutional patterns can be discerned with 
reasonable diagnostic accuracy when both quan- 
titative and qualitative factors are employed. 
Quantitative factors differentiate the involu- 
tional from other types of mental disorders. 
Significance figures show that only qualitative 
factors aid in the differential diagnosis of para- 
noid and depressive involutionals. 
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A Cross-Validation of Suggested Rorschach 
Patterns Associated with Schizophrenia ` 


Harold Rubin and Murray Lonstein 


Veterans Administration Hospital, Lebanon, Pennsylvania 


In a recent study Thiesen [2] has identified 


several quantitative combinations of Rorschach 
structural variables as being associated with 
schizophrenia. Five tentative patterns are of- 
fered as being of diagnostic value in differenti- 
ating between a patient group diagnosed as 
schizophrenics and a “normal” control group. 

Such a pattern-analytic approach to the 
Rorschach may succeed in isolating combina- 
tions of Rorschach variables which may identi- 
fy certain pathological groups. This approach 
may be regarded as a step closer to establishing 
the validity of discrete Rorschach variables. 

Thiesen [2] is aware of the limitations of 
his findings and points out the need for cross- 
validating the patterns which have emerge 
from his investigations. In the present study, 
the authors have attempted such a cross-valida- 
tion by applying Thiesen’s findings to another 


schizophrenic sample. 
Procedure 


The subjects used in the present study were 
taken from a group of hospitalized male pa- 
tients diagnosed as schizophrenic by the psy- 
chiatric staff of a Veterans Administration 
Hospital. Rorschach tests wert administered 
individually to the patients by the authors who 
utilized Beck’s revised scoring system 
Only those records having ten or more scot- 
able responses were retained for this study. 
A total of 42 protocols was obtained. 

The Rorschach variables which comprised 
the patterns suggested by Thiesen [2] as be- 
ing associated with schizophrenia were selected 


from the protocols. The numerical value of 


each variable was assigned to one of three 


categories of magnitude, “low, medium, and 


1 From the Veterans Administration Hospital, 


Lebanon, Pennsylvania. 


high,” as established by Thiesen on a normal 
control group. Tables were then constructed 
which described the frequency of occurrence 
of the suggested patterns in the present sample. 
These data were analyzed by the chi-square 


technique. 
Results 


In Table 1 are listed the five patterns sug- 
gested by Thiesen. Here comparisons are 
made between the findings of the present study 
and Thiesen’s control group. In patterns 4, B 
C, and E no significant differences were obs 
tained, while pattern D was significant at the 


.05 level. 


Table 1 
Patterns Associated with Schizophrenia 
Pattern Description Guise Ballonts sie 
(N= 157) Nea 
A An: High } 1 1 .02 
Sex: High (0.6%) (2.3%) 
B F+%: Low 
Z Score: | 2 2 66 
Low J (1.3%) (4.7%) 
C FC+: Low 
M: Low 0 1 .50 
A%: Low (0.0%) (2.3%) 
D F+%: Low!) 
Pe Low 1 3 4.2 
3 20 
A%: Low J (0.6%) (7.1%) 
E DW: High 
FC+: Low } 1 1 02 
(0.6%) (2.3%) 


Table 2 indicates the frequency of occur- 
rence of one or more of the patterns in both 
the present sample and ‘Thiesen’s control 
group. It is observed that 7 of the 42 pa- 
tients or 16.7% were characterized by one or 
more patterns, whereas 5 of the 152 controls 
or 3.2% had one or more of these patterns 
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There was only a single occurrence of more 
than one pattern in any record, a combination 


of patterns 4 and C. 
Table 2 


Frequency of Pattern Occurrence in Control 
and Patient Populations 


= Number of Patterns Total 
‘ota 
roup None One or More a 


Controls 152 5 157 
(96.8%) (3.2%) 

Patients 35 7 42 
(83.3%) (16.7%) 


Chi square = 10.634, p<.01. 


Table 3 compares the frequency of occur- 
rence of one or more of the patterns between 
Thiesen’s schizophrenic group and the present 
schizophrenic group. The authors’ findings in- 
dicate 7 of the 42 records or 16.7% have one 
or more patterns, while Thiesen reports that 
29 of his 60 patients or 48.3% fall in this cate- 
gory. This difference yielded a chi-square 
value of 9.50, which is significant at the .01 
level of confidence. 


Table 3 


Frequency of Pattern Occurrence in Both 
Patient Populations 


Number of Patterns 


Group None One or More Total 
Patients 35 7 42 
(Authors’) (83.3%) (16.7%) 
Patients 31 29 60 
(Thiesen) (51.7%) (48.3%) 
Chi square = 9.50 ; p<.0l, 
Discussion 


In contrast to Thiesen’s results, which 
showed significant differences of all five pat- 
terns between his patient group and the control 
group, the authors found that only pattern D 
appeared to discriminate between their patient 
group and the controls. Because of the small 
frequency in each cell, this finding may be of 
doubtful significance. 

Thiesen reports the presence of one or more 
patterns in 48.3% of his schizophrenics as com- 
pared with 3.2% of his controls. This would 
be a valuable diagnostic finding. In this cross- 


Table 4 
Frequency of Occurrence in Magnitude for 
Variables Comprising Patterns 4, B, C, 
D, and E in the Present Schizo- 


phrenic Sample (N = 42) 

Variable Low Medium High 
An 19 12 11* 
Sex 36 3 3 
F+ 17 11 14 
Z 10° 31 1 
FC+ 31* 5 6 
M 16" 24 2 
A% s* 18 16 
P 22° 18 
DIV 37 0 5* 
” Maxnitudes of the variables specified in the pat- 

terns. 


validation, however, only 16.7% of the schizo- 
phrenics were found to have one or more pat- 
terns. This shrinkage lessens the clinical utility 
of these patterns. 

Examination of the data in Table 4 shows 
that of the individual Rorschach variables co™” 
prising patterns 4, B, C, and E (those patterns 
not found to be discriminatory) only three var- 
iables would appear by inspection to charac- 
terize the present group of schizophrenics. 
These are low FC+, low M, and low P- 

Although the present schizophrenic grouP 
differed significantly from the control grouP 
(Table 2), it also differed significantly from 
Thiesen’s schizophrenic group (Table 37: 
This discrepancy indicates a lack of homo- 
geneity in the total schizophrenic population 
sampled in both studies and underlines t 
limited value of the pattern approach. 


Summary m 
RISS P to 
A cross-validating study was carried associ 
Thiesen’s suggested Rorschach patterns Pizo 
ated with schizophrenia. Forty-two 4 an 
phrenic Rorschach records were analyze% 


Pi oup. 
these patterns failed to characterize this 8" 
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Differences Between the TAT Responses of 
Negro and White Boys 


Paul H. Mussen 


The Ohio State University 


. The extent to which an individual’s projec- 
tions may be determined by group membership 
and sociocultural factors as well as by personal 
idiosyncratic factors has had little systematic 
study. It seems reasonable to assume that 
there will be “consistent differences between 
the fantasy productions of individuals who be- 
long to, or have been socialized in, different 
social groups. Thus, a certain amount of the 
variation in any TAT production can be ac- 
counted for by the fact that the individual has 
grown up in a given milieu or social role” [5, 
p. 16]. Henry [4] found that there were 
systematic differences between the fantasy pro- 
ductions (TAT stories) of Hopi and Navaho 
children which reflected important differences 
between their cultures. 

In their study designed to test the assumptions 
underlying the Thompson TAT, Riess, Schwartz, 
and Cottingham showed that “Negroes and whites 
in the North produce stories that differ insignificant- 
ly in length regardless of whether the stimulus ma- 
terial is Negro or not and regardless of the color 
of the experimenter” [7, P- 708]. Using a reliable 
measure of the number of ideas contained in the 
stories, these same investigators also concluded that 
these two groups “produce ideas in the TAT situa- 
tion that are not statistically different in number 
regardless of whether the stimulus material is Negro 
or white and regardless of the color of the experi- 
menter” [8, P- 396]. 

Although these findings make it clear that 
differences between Negroes and whites in the 
ity of production in response to the TAT 
nificant, they contribute nothing con- 
cerning the possible dynamic differences be- 
tween the two groups’ fantasy productions. 
Since Negroes and whites in America grow up 
in different social milieux and consequently are 
subject to different cultural pressures, it may 


be predicte! j 


quant 
are insig 


d that their responses to projective 


materials will differ. The present study was 
designed to investigate differences between the 
contents of the TAT stories of Negro and 
white children in New York City. 


Method 


In connection with a study of personality 
and social factors related to changes in chil- 
dren’s attitudes toward Negroes, the author 
[6] administered 13 TAT cards to lower-class 
Negro and white boys from New York City 
who were vacationing at a social agency’s sum- 
mer camp.? The cards used were: 1, 2, 3, 4. 
6, 7, 8, 12, 13B, 14, 16, and 18GF of the 
Murray TAT and another card, not part of 
the regular series, which depicts a smiling 
woman leaning over a baby’s crib and giving 
the baby a pacifier, while a boy about eight 
= m an the crib. 

he data of the present stud i 
from the protocols of 50 ees bei gp 
boys of at least normal intelligence. The sub- 
jects were matched in age so that there were 
equal numbers of white and Negro boys at 
each age level between nine and fourteen. 


All TAT stories were analyzed in accorda 
with a scheme suggested by Stein [9] and moded 
somewhat by the author. The scheme in t : 
counting the needs and press of the heroes T te 
stories, the assumption being that the stor ‘tlle a 
identified with the hero; the hero’s weed poy 
same as the child’s needs; the press tiat n 
upon the hero are the same as the prens ae e 
the child telling the story. se theta fect 
Twenty-eight needs and 2: i 

employed in the analysis At eee ss 
for each subject for each personality variable e 
need and press) was derived by adding the e 


1The author wishes to acknowledge his i 

shes k ge his ind - 
ness to the Community Service Society of ea 
for granting permission to carry out this stud; a 
their boys’ camp. Sua ae 
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Number of White and N 


Paul H. Mussen 


Table 1 


egro Subjects above the Mean on 50 TAT Variables 


TAT Variable 


Definition of Variable 


*n Achievement 
n Acquisition 1 
n Acquisition 2 
n Affiliation 1 
*n Affiliation 2 
n Affiliation 3 
*n Aggression 
n Aggression 2 
*n Aggression 3 
n Aggression 4 
*n Aggression 
(kill) 
n Autonomy 1 
z Autonomy 2 
n Autonomy 3 
n Deference 1 
n Deference 2 
*n Deference 3 
2 Dominance 
z Exposition 
n Nurturance 1 
n Nurturance 2 
n Nurturance 
n Passivity 
n Playmirth 
n 
n 
n 


*, 


Recognition 
Regression 
Succorance 
Understanding 
Ż Acquisition 
Ż Affiliation 1 
*p Affiliation 2 
Ż Affiliation 3 
p Aggression 1 
p Aggression 2 
*p Aggression 3 
*p Aggression 4 
*p Deference 1 
*p Deference 2 
Ż Dominance 1 
p Dominance 2 
~ Dominance 3 
p Example 


*. 


D] 


Ż Lack 
Ż Loss 


Ż Loss (parents) 
Ż Nurturance 1 
Ż Nurturance 2 
Ż Physical danger 
Ż Physical danger 
(parents) 
*p Rejection 


To work at something creditable 
To work for money, possessions 
To steal, cheat, swindle 

Enjoying parent's company 

To establish, maintain friendly relations 
To fall in love, marry 
Self-defensive aggression 
Physical, asocial aggression 
Emotional, verbal aggression 
Destruction, smashing, breaking 
Killing in anger 

To escape, avoid restraint 

To resist coercion 

To misbehave, be unruly 

To submit unwillingly to another 
To comply willingly, obey 

To express admiration, respect 
To lead, manage, influence others 
To inform, explain 

To be kind, helpful to parents 
To be kind, helpful to others 

To seek food, drink 

To enjoy relaxation 

To indulge in pleasurable activity 
To seek approval, prestige 

To think of early childhood 

To seek aid, sympathy 

To think, reflect, speculate 

Hero robbed, swindled 

Hero and parents united 
Friendly relations established with hero 
Love for hero expressed 
Retaliation against hero 

Hero punished 

Hero assaulted, injured 

Hero hated, quarreled with 
Hero’s leadership followed 

Hero admired, respected 

Hero forced to do something 
Hero prevented from doing something 
Hero persuaded, pleaded with 
Hero influenced 

Hero lacks something he needs 
Hero loses something 

Hero’s parents die 

Parents help hero 

Hero helped, encouraged 

Hero’s well-being threatened 


_Hero’s parents endangered 


Hero rejected, scorned 


2 


* Significant at 5% level or better. 


High High Chi- 
Whites Negroes Square 
N N Value b 
24 6 15.40 <.01 
26 19 1.98 10—.20 
26 22 -64 30—.50 
29 24 99 .30—.50 
19 9 4.95 -02—.05 
24 15 3.41 05—.10 
22 6 12.66 <.01 
29 27 16 50—.70 
15 26 4.98 02—.05 
12 8 1,00 a 
30 14 10.36 <0 
13 20 2.21 10—.20 
31 33 A7 .50—.70 
25 35 3.17 mn 
13 17 76 ae 
29 27 16 oT 
14 3 8.58 <: - 
23 18 1.03 ae 
26 24 .16 Simi i 
13 18 1.17 ie 
29 18 4.84 a 
17 19 17 50—+ 
11 20 3.78 piet 
22 26 64 30—5 
16 9 2.60 10—.20 
6 7 09 ee 
19 22 37 GE 
18 32 7.84 S50 
20 21 04 0 
23 19 65 es 
30 16 7.88 “10 
21 13 2.85 i 
10 15 1.34 eae 
23 18 1.03 Oh 
10 28 13.70 Zo 
15 31 10.30 gis? 
18 7 6.46 “Al 
34 16 12.92 10—20 
24 31 1.98 Ew 
17 26 3.30 ‘10—20 
24 31 1.98 p —-20 
11 17 1.78 ao 70 
16 14 19 ‘30—30 
29 23 1.34 ‘30—50 
28 24 -64 ‘0—20 
20 28 2.58 4,00 
19 19 0.00 10—20 
27 19 2.58 
50—70 
23 20 44 01—02 
18 zd 6.46 
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of times it appeared in the thirteen stories. A list of 
the needs and press scores used, together with brief 
definitions of them, is found in Table 1. In order to 
eliminate bias, all scoring was done “blind,” that is, 
independently of knowledge of the subject's race. 


Results 


The mean score for the entire group of 100 
subjects for each of the 50 TAT scores was 
determined. Subjects having scores above the 
mean score for a given TAT variable were 
considered “high” in that particular need or 
press; subjects having scores below the mean 
score for a given TAT variable were con- 
sidered “low” in that variable. Chi-square 
tests were used to determine whether or not 
there was a significant difference between the 
number of white and Negro subjects scoring 
high on each of the TAT variables. 

Of the 50 chi squares computed, 14 yielded 
chi-square values which were significant at the 
5% level or better. Table 1 lists the TAT 
variables, the number of Negroes and whites 
high in the variable, the chi-square value ob- 
tained, and the level of confidence. There is 
a considerably greater number of significant 
differences than could be accounted for on the 
basis of chance alone. 


Discussion 

Examination of Table 1 makes it clear that 
there are many significant and consistent dif- 
ferences between the contents of Negro and 
white boys’ responses to the TAT. 

The minority group understandably sees the 
general environment as more hostile than does 
the white majority group. Thus, a significantly 
greater number of Negro than white boys tell 
many stories in which the hero is hated, scold- 
ed, or reprimanded (p Aggression 4) or is the 
victim of physical assault (p Aggression 3). 
Despite this, however, their own aggressions 
seem to take a milder form than the white 
group’s. Although they indulge in more verbal 
d hostile thinking (z Aggression 
Jatively less concerned with ex- 
treme aggressive expression ( n Aggression — 
kill) and self-defensive aggression (n Aggres- 
sion 1) than are the white boys. 

The Negro’s view of the environment as es- 
sentially inhospitable, also observed by Cot- 
tingham [1], is further reflected in the find- 
ing that a relatively small number of these 


aggression an 
3), they are re 


subjects see themselves as establishing and 
maintaining ‘friendly relations (n Affiliation 
2), respecting others (x Deference), or being 
kind and considerate of others (n Nurturance 
2). In the same way, they infrequently see 
themselves as being respected (~ Deference 
2), followed, or obeyed by others ( Defer- 
ence 1). 

Their perception of the world as hostile and 
threatening may also imply feelings of inferior- 
ity and helplessness and an attitude of indiffer- 
ence. The broad effects of such an attitude 
may be seen not only in the Negro group’s 
relatively infrequent use of extreme forms of 
aggression but also in the relative paucity of 
responses indicating strivifig for accomplish- 
ment and success (z Achievement), together 
with an emphasis on generally inactive pur- 
suits such as thinking, reflecting, speculating 
(n Understanding). 

By contrast, the white group considers the 
world to be predominantly friendly and they 
respond to it with more warmth and friendli- 
ness. Thus the heroes of this group’s stories 
are leaders’ and respected individuals signifi- 
cantly more frequently than the heroes of the 
Negro boys’ stories. Moreover, they are in- 
terested in establishing and maintaining friend- 
ly relations and are more often depicted as 
kind and considerate of others. Since they are 
relatively secure and unthreatened in the world 
at large, they feel free to strive to achieve 
something creditable, to verbalize their ex- 
tremely hostile fantasies, and to defend them- 
selves against aggression. 

Feelings of rejection, generally by the moth- 
er, (p Rejection) are less frequent in the 
stories of the Negro than of the white boys. 
This may be due to the dominance of maternal 
authority and consequent feelings of identifica- 
tion with the mother in Negro families [2] 
or to more general feelings of security in the 
family situation resulting from the highly per- 
missive treatment of very young children b 
lower-class Negro mothers [3]. Since it eh 4 
that they feel less rejected at home than the 
whites do, the Negro subjects’ attitudes of in- 
difference must be attributed to their perce 
tions of the world at large as-generally hostile 
rather than to feelings of insecurity in their 
earlier familial relationships. 5 

Regardless of what their determinants are, 


376 Paul H. Mussen 


feelings of rejection occur significantly more 
frequently in the protocols of the whites than 
of the Negroes. The relatively large number 
of extremely hostile attitudes found in this 
group’s stories is very probably related to these 
feelings of rejection. 

Evidence from the present study clearly 
supports the assumption that there are major 
differences in the fantasy productions of the 
two sociocultural groups studied. In addition 
to personal dynamic factors, the historical, 
economic, and social forces impinging on the 
group are reflected in the stories told by the 
group members. Apparently a certain amount 
of variation in these projective responses may 
be attributed to the individual’s cultural back- 
ground. Some aspects of his fantasy produc- 
tions may be primarily determined — and most 
parsimoniously explained — by the individual’s 
group membership and only secondarily by his 
unique history of interpersonal experiences. 

It follows that interpretation of an individu- 
al’s responses to projective materials must take 
account of his cultural milieu. A great number 
of responses of a certain kind may be quite 
unusual and perhaps indicative of maladjust- 
ment or unresolved conflicts and tensions if 
they are given by a member of one group, but 
usual or “normal” if given by a member of 
another group. The extent of usualness or 
deviation of projective responses must be evalu- 
ated from the point of view of the individual’s 
group membership and cultural background. 


Summary 
The TAT protocols of 50 white and 50 


Negro lower-class boys were analyzed and 
scored in terms of 50 categories of needs and 
press. There were significant differences be- 
tween the numbers of members of the two 
groups with high scores (above the mean for 
all 100 subjects) in 14 needs and press. 

The Negro subjects’ stories contained signi- 
ficantly more incidents of aggressive press from 
the environment and mild, verbal aggressive 
expression by heroes. Compared with the 
whites, they showed less interest in establish- 
ing and maintaining friendly relations, or be- 
ing kind to, or respecting others. The Negro 
boys’ attitudes of indifference were further 


shown in their infrequent use of x Achieve- 
ment and their emphasis on essentially inactive 
pursuits such as thinking and speculating. 

The white boys scem to suffer more from 
feelings of rejection in the family and more 
frequently express extreme hostility in their 
fantasies. On the other hand, they see others 
as respecting them and following their leader- 
ship and they respond to the generally favor- 
able social situation with establishing friendly 
relations, being considerate of others, and striv- 
ing to achieve something creditable. 

There are evidently major differences in the 
fantasy productions of individuals from differ- 
ent social groups. Dynamic interpretations O 
an individual’s projective responses can be 
made meaningfully only if variations primarily 
attributable to his cultural background are 
taken into account. 
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The Use of Sounds in a Projective Test’ 


Harry A. Wilmer * and May Husni 


Stanford University 


An auditory apperception test has previously 
been reported by Stone [2] in a preliminary 
report. This test consists of 10 records of var- 
ious human, animal, and mechanical sounds. 
The only other type of study in the literature 
of an auditory test is that of the Verbal Sum- 
rial or Tautaphone described by Skinner 

Considering the importance of sound phe- 
nomena in human experience and the paucity of 
experimental studies, it was decided to devise 
a brief collection of sounds that could be used 
for clinical or experimental purposes. After a 
preliminary study [4, 5] in which 75 sounds 
were tested with 117 subjects, the present series 
of sounds was selected as being most productive 
or leading to the most interesting associations. 
A selection of 21 brief sound recordings has 
been played to subjects to study their response 
to sound perception. The need for a projective 
test using this sensory modality to supplement 
visual projective tests is apparent. Such a test 
would be of obvious value with blind subjects; 
moreover, it might complement the visual tests. 


Method 


Two 12-inch double-faced Vinylite records 
have been produced and are available to other 
investigators. The test records were played to 
individual patients in a room with only the ex- 
aminer and the subject present. Instructions 
given the subject followed this general pattern: 


You are now going to hear a series of recorded 
Some of them will be familiar, some 
ds have associations; they bring mem- 
Meeting of the Ameri- 
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ories, stories, thoughts, and feelings to mind. This 
is true of music, cries, words, and so forth. You are 
going to hear 21 sounds, each lasting 20 to 50 sec- 
onds. [Most patients were not told the time in sec- 
onds but this is being done uniformly now.] Sounds 
have different meanings for “different people. We 
are interested only in the meaning these sounds have 
for you. Tell me what your first thought is—what 
comes to your mind—what do the sounds tell you? 
If you wish, make up a story. Are you ready? Now 
what does the sound mean to you? t 


AIl tests were administered by one of the 
authors (M. H.). The sounds were given one 
after another, usually without comment. If the 
tester felt that the subject was reluctant to re- 
veal further thoughts, a carefully phrased 
query was made, usually by restating the last 
phrase the subject had used but in an inquiring 
tone, such as “Sounds like the train was going 
to leave ? As more experience was gained, the 
positions of examiner and subject were consid 
ered of some importance. The individual sat in 
a chair facing the loudspeaker and the tester 
sat behind the subject, out of sight, and took 
down the verbatim responses. ‘Thus the effect 
of the appearance and attitude of the examiner 
was kept to a minimum. 

The sounds employed are as follows: 


1. Train (leaving station, crowd, depot noises) 


2 ee conversation 
A. Is that enough... ? 
B. Yah. 
A. How much is that? 
B. ad Well, just about right... isn’t 
A. I think that’s just about right 
B. Put that away now. i 
A. Just about right. 
P: yor that cover it_ better? 
. Put it away now; 
an a a 
3. Child cry and seagulls, soft background. 
4. Clock striking and crowd noises: “Ya, yä » 
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5. Slow drip of water. : 

6. Organ and poem (male voice, clearly audible 
only on italicized words) : 
To my years hath destiny denied 
The glory of youth. Ah, 
How art thou fled from view, 
Darling companion of my tender age, 
My hope, so sorely mourned! 
Is this the fate that time all men brings? 
Poor wretch, the truth once plain 
Thou wert struck down with ease, thy lift- 

ed hand 
Showing me cold death and a naked tomb 
Afar off grimly stand. 
7. Cry for help and background noises. 


8. Laughter and man and woman conversing: 
A. Where did that damn thing come from? 
B. What thing? 
A. Mother said you can’t always get what 
you want in this world, sister, 
B. What did you expect? 
A. Where is Dad? Where did Dad go? 


9. Music and sobs of woman (15 sec.) and man 


(15 sec.). 
10. Man and woman arguing (man speaks in 
anger): 
Man: Now what did you do all that for 
today! 


(Mumbling answer). 
Huh? (Mumbling answer). 

You know what I’m talking about! 
(Mumbling answer). 
There’s no excuse for it. 

answer). 
You know damn well what I mean! 
(Mumbling answer). 
You certainly did, and I’m ashamed. 
(Mumbling answer). 
Woman: Well, I wouldn’t talk if I were 
you! 

11. Music and water sounds, ending with rush 
of water (splash like fish in water or man 
drowning). 

12. Father scolding child and child crying: Why! 
Why! Why! 

13. Footsteps, faster, doors open, close, open, rush 
of footsteps. 

14, Baby crying and woman singing softly. 

15. Cry of woman and man. 

16. Sucking sounds (human). 

17. Groaning, rubbing, kissing (human). 

18. Breaking wood, ripping cloth. 

19. Drill. 

20. Humming and whistling (man: Shut up!) 
more humming and whistling. 

21. Train bells, (switch engine, 
voices). 


(Mumbling 


loud bang, 


One hundred forty-six protocols form the 
basis of this study. The common factor in all 
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but the college group is an enduring handicap. 
In the course of our study only three patients 
became sufficiently upset to necessitate discon- 
tinuing the test. Each of these was in a group 
other than those reported here; they were, 
respectively, a rheumatoid arthritic, and a de- 
pressed boy and woman. The constant recall 
of the crying, which seemed to be all they 
heard, was upsetting. 


The samples are as follows: 


Tuberculosis patients, who were tested at the San 
Mateo County Sanatorium, San Mateo, California, 
with cooperation of Dr. James Greenwell, Medical 
Superintendent. There were 46 patients, 25 males 
and 21 females, with an average age of 38.7 years 
and a range of 18-74 years. All of the patients yere 
on strict bed rest or very limited exercise and ha 
been in the hospital from one month to three years. 


College students from Stanford University- aes 
were 26 individuals, 15 males and 11 females, er 
an average age of 28.1 years and a range of 22-4 
years. 

Schizophrenic patients were tested at Agnew" 
State Hospital, Agnew, California, with cooperat? i 
of Dr. Walter Rapaport, Medical Superintendent. 
They were all seriously ill committed patients, 
There were 23 paranoid patients, § catatonic, d 
hebephrenic, and 5 mixed type, a total of 43 SU o 
jects. Although the groups here were analyzed Sopr 
arately, for practical purposes and statistical reason: 
they will be considered as one group. 


Blind children were tested at the California 
School for the Blind, Berkeley, with the cooperate 
of Dr. B. Lowenfeld. There were 21 children, 5 
males and 10 females, with an average age O f the 
years and a range of 10 to 16 years, A third 0 ise 
children were totally blind or could only petv/200 
light, while the others had vision of from 1 
to 20/200. We have no other children to repot od 
this time so the factors of blindness and chignon 
must be borne in mind when evaluating their 
sponses in comparison with the other ane at 

Amputees from the Korean War were gearen 
Lederman General Hospital, San tae o 
cooperation of Col. James O. Gillespie, Saë on 
professional services. Most of the panenn i 10 P% 
crutches or in wheelchairs. There were T used. 
tients in this group, so percentages will ee 
They had been hospitalized 3 to 12 A iE 
tated limbs were as follows: one leg, °: i 
1; both legs, 2; both arms, 1. For ad a 


t at 


dminist 
sl 


purposes veterans were required to ta absol 
ment stating in part: “I further agree oc ts 
Government of the United States Seon Ti i 
which may result in connection eee us 
This statement, implying alleged eal responses” 
have played a role in their attitudes 
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Table 1 
Recognition of Selected Sound Components 
T.B. College Schizophrenic Blind 
Sound N NAS tie N=43 N=21 
ou! Jo. : 

nd No % % Paranoid =. Total % % 
1. Train 

a. Crowd 0 77 8 8 16 37 15 

b. Human 33 96 0 2 2 5 38 

c. Street 50 69 8 2 10 23 48 
2. Seawash, conversation 

a. Words repeated 17 27 9 13 22 51 48 

b. Recognized background 15 54 0 0 0 0 81 

c. Crime, police, etc. 26 55 4 4 8 19 90 
3. Child cry, seagulls 

a. Jungle animals 13 54 5 4 9 21 67 

b. Cry mentioned 37 54 14 7 2 49 57 

c. More than one baby 48 23 5 3 8 19 52 
4. Big Ben, crowd 

a. Bells (unspecified) 63 4 0 2 2 5 29 

b. Church bells 46 12 2 9 11 26 24 

c. Sadness, excitement, danger, etc. 52 31 6 4 10 23 28 
5. Water drip . 

a. Miscellaneous fluid 22 100 7 3 10 23 95 

b. Running water 35 4 7 E 11 26 48 

c. Poured into something 37 65 8 : F 28 81 

d. Poured out of something 15 15 8 23 0 
6. Organ and poem 

a, Words recalled 4 i 1 a a Ps 5 

b. Sadness—pleasure 15 8 1 i ; 7 57 

c. Music 68 54 17 0 71 67 
7. Cry for help, crowd 

a. “Help” repeated 57 en 14 y 24 57 62 

b. Violence 41 s 7 : 11 26 95 

c. Remote, unreal 57 3 3 4 9 24 
8. Laughter and conversation 

a. Crowd mentioned 59 a Re ; 9 21 76 

b. Laughter mentioned 52 4 z s a 38 71 

c. Words repeated 20 24 JA 

P bbi 

j ig << or 59 85 15 16 31 74 86 

b. Woman crying 27 “4 i 4 32 76 43 

c. Unreal, remote 61 11 26 62 
10. Man and woman arguing 

a. Man mentioned 95 92 18 11 29 69 86 

b. Man at fault 27 12 0 0 0 0 i4 

c. Woman mentioned 89 85 13 9 22 52 90 

d. Woman at fault 11 50 4 1 5 12 62 
11. Music and water 

a, Water mentioned 42 81 14 10 24 60 100 

b. Concert 63 27 8 10 18 45 14 

c. Something in water 54 65 11 4 15 37 72 
12. Father scolding son 

a. Provocation indicated 98 85 0 2 2 5 36 

b. Reprimand (not spank) 70 23 11 8 19 49 43 

c. Crying 20 30 6 4 10 26 s57 
Child's 7 69 2 5s 7o å 4 is 


d. Child’s feelings 
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Table 1. (Continued) 


T.B. College Schizophrenic Blind 
N=46 N=26 N=43 N=21 
Sound No. cg, Paranoid Other Total oz an 
% 7 Number A = 
13. Footsteps and door - 
a. Story indicated 67 42 12 3 15 38 25 
b. Difficulty walking 29 8 1 0 1 3 15 
c. Leaving 14 31 1 1 2 5 45 
d. Fear, anxiety 24 50 5 1 6 15 55 
14. Baby and woman singing 
a. Crying 52 54 11 13 24 62 55 
b. “Mother” 10 85 11 13 24 62 60 
c. Child’s difficulty mentioned 69 73 1 8 20 50 
d. Rocking, singing 67 35 12 1 26 67 60 
15. Cry of man and woman 
a. Death, tragedy 44 32 5 1 6 15 20 
b. Man and woman mentioned 54 40 9 2 1 28 46 
c. Woman alone 28 8 7 12 9 49 7 
d. Laughter (not on recording) 9 0 0 2 2 5 20 
16. Sucking 
a. Total oral sounds 14 40 9 4 13 44 38 
b. Person mentioned 33 56 7 i 3 22 28 
c. Mechanical sounds 43 24 6 4 i 26 19 
d. Sucking recognized 12 8 1 H H Š i4 
17. Groaning, rubbing, kissing 
a. Sleep described 60 16 5 
$ 
b. Sleep mentioned 86 37 10 6 11 27 1 
P 12 22 55 42 
c. Dreaming 43 8 1 i 37 
18. Breaking wood, tearing cloth > $ 
a. Tearing 30 71 
b. Wood mentioned 17 37 5 8 18 45 a 
c. Grinding, drilling, machinery 32 0 i 2 5 12 4 
19. Drill 3 3 7 
a. Saw, sawmill 59 
b. Big log sawed i7 - 4 3 7 20 13 
c. Power described 35 9 9 0 0 0 . 
20. Humming, whistling, “shut up” i 1 3 
a. Humming (woman) 71 
b. Whistling (man) “a gg 2 2 s3 63 
c. “Shut up” 50 ag 12 11 23 61 58 
d. Man justified Yo & è 5 14 37 63 
21, Switch engine, loud “pop,” crowd 3 0 3 8 42 
a. Train 60 
b. Bell (train) 17 9 9 18 49 33 
P 16 0 
c. Gun or explosion 27 0 3 3 8 11 
d. Streetcar 14 a0 5 2 7 19 23 
3 0 3 8 6 
All patients were male, with 


an average 
23.2 years and a range of 18-36 years, Beas 


number of subjects, the single sex, and 
statement set this group apart. 


though there are a number of components, the 

the signeg three with the greatest response or divergenc® 
of response were selected for comparison 4” 

The responses of individuals to the sounds eai E thig study. The great difficulty a 

EE en er rin to their Tecognition of mii ee complex ‘ ep be 

em —— beni ‘i Se of each of the obvious. So as 5 dia, sere eel experienc 

sounas, p'e, in the first sound, al- interpretations the Sra fragmented ige 
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to their component parts and the answers tabu- 
lated in relation to the frequency of similar 
responses to sound components. 

The percentage of each of the groups recog- 
nizing or acknowledging in any way the com- 
ponent of each sound is given (Table 1). The 
number of amputees was too small to include. 

‘The test required an average of about 35 
minutes to administer, with a range of 25 to 85 
minutes. The longest average time was 38.8 
minutes in the case of the hebephrenic and cata- 
tonic schizophrenics, and shortest in the ampu- 
tee group, 28 minutes. Eighty-six per cent of 
the subjects completed the entire test and 97% 
completed at least half. Only 7% rejected part 
of the test for personal reasons, viz., “I’m not 
nuts,” etc., and 7% were unable to finish for 
reasons beyond their control, such as mealtime 
in the hospital, etc. Six patients refused the 
test completely before it was begun, three of 
these being amputees who had to sign a release. 


Sample Responses 


A 26-year-old paranoid schizophrenic patient 
responded to Sound 7 (cry for help) in the 
following manner: 


That would appear as if a person were calling 
for help, could be any state, either mental or physi- 
cal...the person is calling from...I felt precisely 
that way a number of times, and I assure you it’s 
not a very pleasant feeling. . its a feeling of ex- 
treme confusion. Q: Extreme confusion? A: Yes, 
or wanting something that was not available. There 
are certain personalities that affect you, ..that man- 
ner...haying someone repeat the facts over and 
over...gave me that feeling of yelling for help. 
Q: Of yelling for help? 4: Yes, that’s in a remote 
sense. I want to be away from that person...I don’t 
want to be with him. (25”) In fact, I would say that 
sound would represent a mental picture of how I 
felt so many times. (15”) I have an older brother 
...and specially my older brother has always... 
well, not always, has at times (8”) made more of 
an issue out of the things I said and developed them 
into problems. Whether he realized it or not, it 
bothered me...the fact that I had a paralytic stroke, 
having lived with him...after I left the University 
of California I went to live with him. I went to 
work in an oil well...I said I wanted a car...and 
he took it over from there (15”) that we painted it 
and put a new top...and he took the car...it was 
a brotherly attitude on his part, but I don’t believe 
he has much insight on my personal taste. 


His responses in general revealed considera- 
ble fantasy, were frequently disjointed. He felt 


a strong identification in the cry for help; it 
connotes confusion and is, he believes, a reason- 
ably good picture of his own mental state, 
while the crowd is being warned away from 
that person. There is no mention of help com- 
ing or of concern of the people for the plight of 
the individual. Although there are many words 
on the two records, the only one the patient 
recognized was the word “help.” 

In the protocol of an eleven-year-old blind 
boy his responses to the cry for help is as fol- 
lows: 


Well, I have two things for that. Could be a 
boxer slowly getting knocked out... it could be in 
the old days, getting a beating, or being hanged. 
Q: Or being hanged? 4: The way he stopped at 
the end, it sounded like he was being hanged... 
and a courtroom. A boxer would be saying “No, 
no.” I guess that's it. 


The patient does not mention the word 
“help,” considers the man’s plight could be one 
of two things, both violent physical punish- 
ment, and that it could have been in remote, 
ancient times. He seems to feel that the sudden 
end is the consequence of being choked, and 

A “ ” 2i s 
imagines that the word “no” might be said by 
a boxer being beaten. 

This protocol was one of rich fantasy, mul- 
tiple associations employing “this or that” or 
“first this, then that.” He often approached the 
sound as if he were attempting to classify it, 
then changed his mind in the course of his re- 
sponse. There was an unusual amount of iden- 
tification of physical setting and time. His 
concern was largely with unseen dangers or 
with danger that would not directly affect him. 
Violence and danger were further indicated in 
the protocol by smuggling, robbing, shooting, 
hanging or being knocked down by an ap- 
proaching dog. 

He mentioned the words in five sounds. 
When he indicated food in Sound 10 
being burnt (identifiable by nonvisual sense) 
and in Sound 13, the footsteps sequence, a 
burglar was robbing the house because every- 
one was asleep (eyes closed) and the burglar 
beat him over the head, knocking him out (so 
that his eyes would not open). The man who 
was sick was sleeping and “could be curtains.” 

These samples will serve to illustrate ty 
of responses. Pers a 
memories in respo; 


. it was 


pes 
and 
oc- 


onal life associations 
mses were unusual and 
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currea most frequently in the college students 
- and the schizophrenic patients, fcllowed by the 
tubercular, blind, and amputees, in that order. 
There was an average of five personal associa- 
tions in the college group, most frequently in 
Sound 1 (35%), and most frequently in the 
schizophrenics (17%) in Sound 9, music plus 
sobbing sequence. The paranoid schizophrenics 
and the other forms of schizophrenics have the 
same percentage of personal associations. 


Results 


A study of the responses of subject groups 
can be summarized as follows: 

Tuberculosis patients. Heard appeal most 
often, cries least often. Angry crowd, death and 
tragedy (mood) but not violence (action) 
were inferred most often. They heard laughter 
most often, even when not in actual recording. 
They were keenest to walking difficulties but 
least keen to perceive oral sounds. Though they 
described hungry babies crying, like all other 
groups, the children were never fed, and only 
once “going to be fed soon.” 

College students. It can be surmised that 
they had emphatic affective responses, with 
strong feelings for right and wrong, with 
considerable anxiety. They had a high response 
to crying and a low one to laughter. Their re- 
sponses indicating violence and sadistic behavior 
were equalled by those of the blind children. 
One does not know the incidence of neurosis 
among this sample, but this could be a signifi- 
cant factor. They heard the doors open and 
close most often; like all groups, if the doors 
were heard only to open or only to close, the 
males predominated over the females about 
2:1. If doors both opened and closed, males 
predominated about 4:3, which is not consid- 
ered significant because of the slight male pre- 
dominance of the total sample. In the tubercu- 
losis group, for example, it was only males who 
heard the door open, while in the college group 
the two female subjects indicating the door 
opening only mentioned that it opened two or 
three times. 

Schizophrenic patients. The paranoids paid 
little attention to words; violence, death, 
tragedy, and laughter were least frequently 
heard, but crying commonly. Their responses 
were definitive, not often guarded, were rich 
but with little movement, oral sounds or needs 
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or gratification responses. 

Blind children. These found the elements of 
violence, death, and struggle more frequently 
than any other group. They detected back- 
ground noises keenly but tended to reject other 
components of sounds when they fixed their 
verbalization on the danger elements. They 
were inclined to refer to the woman and her 
efforts most often. Their own handicap is re- 
flected by comments about walking, unseen 
danger, and warning signals. They referred to 
sucking most often but not to sleep unless there 
was danger in the sounds. 

Considering the small sample of amputees 
the most striking feature was the poverty of 
responses and the subjects’ expressed difficul- 
ties in understanding the sounds. They practi- 
cally never referred to words but frequently 
referred to the affective sounds of laughing 
and crying. When music was associated with 
crying, music was rarely heard; on the other 
hand, when music was heard with water, music 
was frequently mentioned, It would seem the 
impact of crying tended to overshadow music. 
They referred to violence only once. It is inter- 
esting that in the final sound, where a gunshot 
or explosion is often inferred, this was only 
once acknowledged, then as “pop.” These vet- 
erans, having returned from the Korean War 
within recent months with loss of limbs, ex- 
cluded the verbalization (and recognition?) of 
the significant meaning of violence. They were 
most productive of feeling responses in the 
sound of the father scolding the child. 


Discussion 


There are certain limitations to the present 
study. Although we analyzed 146 protocols, 
we do not yet know the value of this test as a 
projective technique, nor its predictive or 1n- 
terpretive importance, We do not have a group 
of nonblind children, and, in essence, our study 
of blind children Permits only comparison © 
them to sighted adults. This is significant, as 1t 
is the setting in which all psychotherapy W! 
the blind takes Place. Subsequent study of es 
nonblind will be reported. Our so-called wee 
mal group (college students) probably ie 
tutes a segment of presumably non-ill young 
adults. It is considered as a group for es 
Son rather than controls, which must inclu S 
subjects of all ages and in all walks of life. This 
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distinction between normal controls and sample 
for comparison is important. 

Despite the fact that we do not yet know the 
value of this test as a projective technique, it 
meets the criteria for such a test as set forth 
by Rapaport [3]: (a) economical, i.e., not 
time-consuming; (b) simple, i.e., feasible for 
office examination and not requiring complicat- 
ed or bulky apparatus (but does require a rec- 
ord player of good tone quality); (c) imper- 
sonal, i.e., does not involve the need to build up 
time-consuming transference relations or com- 
plexes of intense interpersonal relationships, 
such as are present in psychodrama; (d) limit- 
ed to one segment of “behavior”; (e) standard 
in the sense that all subjects face the same ma- 
terial and the same degree of cooperation from 
the examiner. 


Summary 


A sound projection test employing 21 sounds 
on two 12-inch double-faced Vinylite records is 
described. They include simple and complex 
mixtures of verbal, nonverbal, mechanical, and 
natural sounds. Copies of these records are 
available for research purposes, 

Protocols of 146 subjects are analyzed. 
These include tuberculosis patients, schizo- 
Phrenics, college students, blind children, and 


Korean War amputees. No norms can be given. 


The value of the test in interpretation of per- 
sonality structure remains to be understood. 
Tuberculosis patients heard words of appeal 
and crying and inferred violent action more 
than other groups. They described the mood of 
sadness and tragedy as well as laughter more 


than the others. 

College students gave a high response to cry- 
ing but low to laughter. They indicated a 
high degree of violence and sadistic behavior 
responses. They gave the most frequent human 
and mechanical movement responses. 

Schizophrenic patients ignored the words 
and referred least often to violence, death, and 
tragedy as well as to laughter. They acknowl- 
edged the crying in large proportion. 

Korean War amputees rejected the explosive 
and gun responses and the violent sounds, but 
gave rich associations with the father-scolding- 
son sound. 

The blind children gave the most frequent 
recognition of violence and sadistic activity, 
heard the words of appeal and anger most 
often, and reflected their own handicap in their 
responses of unseen danger. 
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For any task to be properly performed, it n 
necessary to include behavior appropriately 

lated to the task and exclude behavior inap- 
enay relatec to it. A failure ee 
to include or exclude is held by Cameron (1, 
3, 4, 6, 7, 8] to be characteristic of certain 
nee of maladjustment. According to 
Cameron overinclusion favors disorganization 
whereas underinclusion? is resorted to in 
attempt to preserve or achieve Stability. n 
terms of diagnostic categories, the conversion- 
hysteric is viewed as a pathological ira 
includer, the schizophrenic as a pathological 
overincluder. A review of the literature reveals 
several studies which have reported overinclu- 
sive thinking among schizophrenics [1, 2; 3, 4, 
14, 15]. Some have noted underinclusive think- 
ing as well [14, 15]. The purpose of the pres- 
ent investigation is to Investigate more thor- 
oughly schizophrenic overinclusion by attempt- 
ing to answer the following questions: 

1. How prevalent is overinclusive 
among schizophrenics? Do they ov 
more than matched controls? Is ove 
more characteristic of some schizoph 
types than others? 


thinking 
erinclude 
rinclusion 
renic sub- 


2. Is overinclusive thinking more character- 


1Based upon a thesis submitted in 1950 in partial 
fulfillment of the degree of Master of Arts at the 
University of Wisconsin, The writer Wishes to 
express his gratitude to Dr. Ann Magaret for her 
advice and guidance. 


bstract of this paper was Presented at the 
ie pore of the Midwest. Psychol. Assn, 


At the time this study was carried out the author 
Was a trainee in the Veterans Administration Pro- 
gram. He wishes to express his appreciation to this 
organization for its support of the study, 

?Uncerinclusion, as used here, has the same mean- 
ing as Cameron’s term, beeen mae Ne has been 
aabetitited merely for reasons of readabi ity. 


3 ive 
istic of schizophrenics than underinclus 
thinking? a 

3. What variables, such as sex, e a 
level, abstract-thinking ability, and inte andi 
impairment, are related to verbal ove 
sion? : 

4. What kinds of words are een 
Most apt to overinclude? Is overinclusion @ oi 
eral characteristic of schizophrenic peace 
is it restricted to certain kinds of ane a 
ing particular significance in terms of in 
ual needs and expectancies ? 


Procedure the 

Description of the Inclusion Test. For er- 

purpose of this investigation an objective pei 
and-pencil test, the Inclusion Test, was 


structed.? satin 
S . s15 
The test is composed of 50 items, each SPs an 
of a key word followed by five response wor 
the word “ 


none,’ 
line all response 
concepts required 
by the key word, 
lows: 

MAN arms 
A correct Perform 
sponse w 


er- 
’ The testee is instructed to und g 
words which designate PER e 
for the complete thing ap l- 
An example of an item is 4 


shoes hat 


ords arms, toes, and head, as oN 
n must have, among other thing® tte , 
a head. For each correct choice a eac! 
erinclusion is received; erinclu- 
Selected, a score of one me words 
Many of the items contai ae 
related to the key Sade meant 
Some items contain = response 
narged. Several key an mbiguous 
ms, and others are so "rhis lat- 
e meaningfully scored. 
3The 


was 
: Test | d 
Scoring system for the Inclus‘on ptaine 


toes, and 


sion is obtained, 
only Superficially 

ang Associations, 
to be emotionally c} 
Words are neologis: 
that they cannot b 


made or 
» In its final form the college group d unde 
equal n 


fi ion an 
umber of errors of overinclusio 
inclusion, 
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ter type is intended to induce confusion by forcing 
impossible discriminations. 


Subjects. The patient sample consisted of 
38 schizophrenics,* 19 of whom were males. 
Only those schizophrenics were selected who 
had not experienced a shock treatment for at 
least two weeks, who were within the age 
range 20-42, in whose case record no question 
regarding correctness of diagnosis had ever 
been raised, and who were assigned to the less 
disturbed wards. 

The control group consisted of 20 men and 
25 women. They were selected from a larger 
group of 97 tested, on the basis of providing 
a close match with the schizophrenics on age 
and vocabulary level. The controls represented 
a wide range of occupational backgrounds, 
having been solicited from among firemen, 
recreation groups, housewives, hispital attend- 
ants, secretaries, and professional people. 

Testing procedure. The Shipley—Institute 
of Living Scale [13] was administered to- 
gether with the Inclusion Test in order to 
allow for an evaluation of the relationship be- 
tween its scores with overinclusion and to pro- 
vide a means for matching schizophrenics and 


Table 1 


Analysis of Variance for Overinclusion Scores of 
38 Schizophrenics and 45 Controls 


Sum of Mean 

Group Mean squares df square 
Normal 12.49 

vs. 1464.87 1 1464.87 12.03*** 
Schizophrenic 20.92 
Male 15.44 

vs. 61.39 1 61.39 1/1.98 
Female 17.16 
+Vocab. 1 19.62 

vs. 

Vocab. 2 14.50 328.65 2 164.32 1.35 
vs. 

Vocab. 3 15.85 

(Error) 9493.96 78 121.72 


*#* Significant beyond the .001 level of confidence. 
+ Vocab. 1 consists of scores of 21-25 vocabulary 
items correct; Vocab. 2 of 26-29 correct; Vocab. 3 of 
80-40 correct. 


4The writer wishes to express his appreciation to 
the staff of Mendota State Hospital, particularly to 


psychologist Phyllis Earnest, for cooperation in se-. 


curing the patient sample. 


controls on vocabulary level. Subjects were 
tested individtally or in small groups. Every 
effort was made to put the subject at ease and 
to insure his comprehension of the task before 
he was allowed to begin. Total testing time 
rarely exceeded three-quarters of an hour. 


Results 


Results are presented in the order of the 
questions raised at the beginning of the paper. 

Prevalence of overinclusion in schizophre- 
nia. The main object of this study was to de- 
termine whether overinclusion in a schizo- 
phrenic group, as a whole, occurs more fre- 
quently than in a control group. The results 
indicated in Table 1 suggest that it does. The 
mean overinclusion score for the schizophrenics 
is nearly double that for the controls. The 
difference between group means is significant 
beyond the .001 level of confidence. 

"The next question to be considered is what 
percentage of the schizophrenics can be classi- 
fied as overincluders. This is a dificult matter 
to decide upon because of a lack of normative 
data defining overinclusion. However, inspec- 
tion of the distributions suggests that a score 
of 18 or more overinclusions might be used to 
determine pathological overinclusion, as such a 
cutting point would separate the mode of the 
schizophrenic distribution from the mode of 
the controls. Sixty-three per cent of the schizo- 
phrenics and 22 per cent of the controls fall 
beyond this point. Thus, many schizophrenics 
(379) do not overinclude more than most 
controls, and overlap between the groups 
rather than sharp separation is the case. 

An analysis of variance did not indicate dif- 
ferences in overinclusion among the subtypes of 
schizophrenia. The sample included 7 “mixed” 
or “undetermined,” 12 “hebephrenic,” 14 
paranoid,” + ‘ catatonic,” and 1 “simple.” De- 
spite the lack of significant differences, the or- 
der of the means of the subtypes did suggest 
that the greater the personality disorganization 
the greater the overinclusion. j 

Overinclusion in relat 
An analysis of variance 
score, analogous to he o 
Table 1, reveals no diff 
zophrenic and control 
inclusion. Of interest 
the controls make abo 


ion to underinclusion, 
for the underinclusion 
ne for overinclusion in 
erence betwen the schi- 
group in mean under- 
is the observation that 
ut an equal number of 
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erros of overinclusion and underinclusion, with 
means respectively of 12.49 and 12.10, while 
the schizophrenics make almost twice as many 
overinclusions as underinclusions, with means 
respectively of 20.92 and 12.20. It thus appears 
that the difficulty schizophrenics have in ver- 
bally establishing boundaries in the Inclusion 
Test is predominantly a result ofa tendency to 
overinclude. 

Overinclusion in relation to other variables, 
Inspection of Table 1 reveals that, within the 


it influenced by vocabulary level, Abstract- 
thinking ability, as measured by the Shipley 


scale, is also not yound to be significantly cor- 


schizophrenia, Le., the greater 
tion, the greater the Overinclusion, 


inds of materials schiz 
include. A chi i 


and controls at beyond the 0. 
dence. This is considerably beyond the 


trols make no choice or one ch 
neologism, while schizophre 
quently make two, As 
Phrenics were matched 
differential handling of 
explained in terms of fa: 
A possible explanation w. 
taneous comments made by Some of 
tients, indicating an uncertainty abo 
they did and did not know. Fo 
patient, upon coming to the n 
pitch,” remarked, “Isn’t it a sh 


nics not 


on vocabulary, their 


5The absence ot a significant ð 
readily be attributed to unreliabilit 
sion Test, as the corrected split-ha} 
efficient for the overinclusion Score wag 
90 (N=83), 


words you’ve used all your life suddenly escape 
ou?” $ 
g Inspection further indicated that the schizo- 
Phrenics inappropriately chose words related to 
material things and sense impressions. heir 
more schizophrenics than controls incorrectly 
selected wood as necessary to a Box, bes 
More controls than schizophrenics incorrectly 
selected corners. Also, schizophrenics, a 
than controls, tended to select specific examples 
of a Category as necessary for that category 
(ie, a lion is required in order to have be 
Animal), Such behavior is in line with Go a 
Stein's [] 1] description of schizophrenic a 
ing as Concrete and indicative of a “loss in t 
abstract attitude,” hat 
ualitative analysis further suggested t a 
the schizophrenics, more than the edird wa 
Sponded with “loose associations” rather tha 


x isms 
at schizophrenics respond to neolog' 
and choose re 


Discussion cute 
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The findings In this study support 
eron’s view that s 
Inclusive, 


5 foun 
Y no underinclusion was 
mises a questi 


w #8 both Shneidman [14] an 
reported underinclusive as ups: 
ve behavior in their go we 
“reas other explanations are possible, 7 
Suspect the discrepancy in findings is a 1° 
of differences in the tasks in two respects: 
one, the Inclusion Test offers many assocl@ ar- 
istic choices, which the schizophrenic seems P’ 


A sion 
ticular] t to respond to. Thus, overinclus i- 
'S favored p the nature of many of the ole 
vidual item 
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1zarre choices for which there are no CO 
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responses. It may be that underinclusion, when 
it occurs among schizophrenics, is a reaction 
formation to a more basic overinclusive tend- 
ency in an attempt to prevent or ward off dis- 
Organization, and the Inclusion Test, because 
of its confusing nature, disrupts the develop- 
ment of a rigid defense system. Of interest, in 
this connection, was the reaction of one patient 
who underlined only the word none, having 
explained that no response, including the ones 
indicated in the illustrative examples at the 
beginning of the test, met her criteria of per- 
fection. She was negativistic throughout the 
Session, becoming increasingly irked with the 
test, and finally refusing to complete it. Had 
she proceeded in her test behavior to the end, 
she would have received a score of extreme 
underinclusion. One is tempted to conjecture 
here that she was able to prevent the collapse 
of her underinclusive defense system only by 
withdrawing from the task. That underinclu- 
sion may be a reaction formation to over- 
inclusion is also in line with reports on the use 
of rigidity as a defense mechanism [9, 10, 11]. 

Why the schizophrenic overincludes, associa- 
tionistically or otherwise, is not immediately 
apparent. Cameron, who originally used the 
concept of overinclusion descriptively [4], has 
more recently attempted to explain it in the 
following manner: “. . . a strong hypothesis, 
arising in response to anxiety-provoking un- 
certainty, begins by broadening the generaliza- 
tion gradient and developing overinclusion, . .” 
[8, p. 306]. Whereas this explanation may ac- 
count for certain kinds of overinclusion, it 
does not account for the results observed in 
this investigation, for on the basis of a “strong 
hypothesis” theory one would predict under- 
inclusion as well as overinclusion in the test 
used here. It might simplify matters if two 
types of overinclusion were differentiated. One, 
the kind resulting from strong needs or expect- 
ancies, could best be included under the con- 
cept of selective perception, and would involve 
overresponding to material related to subjective 
hypotheses and simultaneously underrespond- 
ing to other material. This investigation has 
revealed a different type of overinclusion, 
which we suspect is a result of a failure in 
discrimination, arising out of a defect in at- 
tending. That schizophrenics suffer from an 
attention defect has been shown in several stu- 


dies [5, 12]. Whether such a defect impairs 
discrimination and favors diffuse generaliza- 
tion of the type demonstrated by our schizo- 
phrenics remains for future research to deter- 
mine. Operationally, this hypothesis can be 
tested by determining whether overinclusion 
increases as attention level is experimentally 
decreased, and whether it does so more than 
underinclusion. Obviously, the prediction of 
increasing overinclusion with decreasing atten- 
tion can be expected to hold only within limits, 
for with extreme inattention the individual 
would not be responding at all to the task at 
hand, and so, in a sense, would be underinclud- 
ing. It is therefore hypothesized that the curve 
of overinclusion as a function of decreasing 
attention rises gradually at first, then falls 
sharply when almost all attention is withdrawn 
from the task at hand. 


This study raises several questions. For one, 
it has been shown that on the basis of Cam- 
eron’s concept of overinclusion the reaction of 
schizophrenics to a particular test situation 
could be predicted. But the schizophrenic rep- 
resents only the overinclusive end of the con- 
tinuum. Is Cameron’s theory correct in view- 
ing the hysteric as an underincluder, and 
would such behavior be opposite but analogous 
to schizophrenic overincluding ?° Another ques- 
tion that arises is whether overinclusion js 
characteristic only of schizophrenic behavior, 
or whether it is equally prominent in other 
psychoses. We believe that any state of disor- 
ganization favors overinclusion, but this re- 
mains to be tested. A third matter that might 
profitably be investigated is what other corre- 
lates of overinclusion or underinclusion, be- 
sides “intellectual impairment,” can be found 
to help relate overinclusion and underinclusion 
to clinical behavior. For example, how does the 
non-overincluding schizophrenic differ from 
the overincluding schizophrenic? Does he have 


SIn a preliminary study the Inclusio; 
administered to six patients demonstrating un 
plicated conversion-hysteric symptoms, Their en 
scores and the control group’s for both overinclusion 


n Test was 
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a more favorable prognosis? Do rigidity and 

defensiveness favor underinclusion, as was hy- 

pothesized? Can certain kinds of hallucinations 
be explained in terms of the overinclusion of 
normally unheeded perceptions? A positive Te- 
lationship between some kinds of hallucinatory 
experience and score on the Inclusion Test 
would support such a view. 


1. Schizophrenics, as a group, overinclude 
significantly more than controls, Whereas con- 
trols, on an average, make about 


2. Schizophrenics, 
differently from con 
inclusion. 


as a group, do not behave 
trols in regard to under- 


vocabulary 
level, and abstract reasoning are not related to 
egree of overinclusion On the other hand, 


overinclusion, 


concretely 
© even over- 
of which he 


at hand. H 


responds to’ words the meaning 


does not know, 
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Intellectual Deficit in Organics and Schizophrenics 


Sheldon R. Rappaport 


Department of Psychiatry, Albert Einstein Medical Center, 
Southern Division, Philadelphia, Pa. 


This study, part of which was reported ina 
Previous paper [20], is an investigation of the 
tole of behavioral accessibility in intellectual 
deficit. This paper specifically deals with de- 
termining whether organic or schizophrenic 
psychotics show significantly greater intellec- 
tual deficit on specific tests and whether such 
deficit can be attributed to organic or func- 
tional factors, the latter rated by behavioral 
accessibility scores on the Elgin Test Reaction 
Scale [20]. 

The previously reported selection of the sam- 
ple and conditions of the study are summarized 
below. The test batteries selected to be admin- 


istered to these patients were comprised of test 
eee to reflect most adequately intel- 

al areas in which Psychotic Patients may 
show deficit, Vocabulary was also measured be- 
Cause it js widely held as the best estimate of 
Premorbid level of function, It is recognized 
that the designations for these areas are merely 
summative indices of more complex functions 
[17]. 

Because of the difficulty of maintaining the 
cooperation and attention of psychotics, it was 
decided that the selected tests should be ar- 
ranged in two batteries, each requiring approxi- 
mately the same time (usually around 40 min- 
utes) for administration. To introduce each 
battery with a test which would facilitate rap- 
Port, to permit proper placement of the digit- 
Span test, and to allow for delayed recalls, the 
following order of tests was devised: 


Test I 


1. Information, subtest of the Wechsler-Bellevue, 
I [26]; an index to availability in consciousness of 
a fund of general information obtained by cumula- 
tive interest in the environment. 

2. Recall I, the news item from X, 3 of the Stan- 
ford-Binet, L [22]; an index to the accuracy of im- 
Mediate recall of meaningful material, 


3. (a) Digits Forward and (b) Digits Reversed, 
subtest of the Wechsler-Bellevue, I; an index to au- 
ditory attention span. 

4. Memory-for-Designs test, by Graham and Ken- 
dall [7, $]; an index to the accuracy of visual or- 
ganization and reproduction of imagery. 


5. Recall II (same as 2 above) ; an index to the 
accuracy of retention and delayed recall of mean- 
ingful material. 

6. Block Designs, subtest of the Wechsler-Belle- 
vue, I; an index to analytic-synthetic thinking. 

7. Vocabulary, the Thorndike short-form of the 
Binet Form L Vocabulary [24]; the best single 
estimate of premorbid level of intellectual function. 


Test U 
1. Comprehension, subtest of e Wa 


vue, 1; an index to understanding of sovial factor 
b e aM a OTS 


and requirements, as funda ntal to si 7. 
s mer iz i 
, social Judg- 


2. Word Pairs #, the word par Pr 
Minnesota Tess of Organre Brave B 
an index to formation ef new, 


rore ass P 

3. Vocabulary, subtest of the Wechsler Bellevue 

I; the best single estimate of Premorbid e 
intellectual function. 

4. Sorting test, the Weigl-Goldstein-Scheerer Col- 


or-Form Sorting Test [6]; an index to concept for- 
mation. 


level uf 


5. Word Pairs II (same as 2 above); an index 
to retention and delayed recall of newly formed 
rote associations. 


Tests I and 1I w 
at the same hour on two suci 
ing to the prescribed 
tests used. At each 9 
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Scoring Procedure 


Wherever established scoring procedures 
were available, they were followed. Two tests, 
the Sorting test and the Cube test, had no 
such standardized, quantitative scoring meth- 
ods. 


To obtain a quantitative means of evaluating the 
Sorting test, the writer devised a system of weights 
for the various performances on this test. These are 
described in Table 1. This scale is based primarily 


upon the principles set forth by Goldstein and 
Scheerer [6]. 


Table 1 


Scale of Weights for Performance on the Weigl- 
Goldstein-Scheerer Color-Form Sorting Test 


Spontaneous sorting and shifting, both concepts 
abstract 


19 Both verbalized 
18 One verbalized 
17 Neither verbalized 
Spontaneous sorting and shifting, one concept 
abstract 
16 Both verbalized 
15 One verbalized 
14 Neither verbalized 
Spontaneous sorting and shifting, both concepts 
concrete 
13 Both verbalized 
12 One verbalized 
11 Neither verbalized 
Induced sorting and shifting, 
10 Both verbalized 
9 One verbalized 
8 Neither verbalized 
Induced sorting and shifting, 
abstract 
7 Both verbalized 
6 One verbalized 
5 Neither verbalized 
Induced sorting and shifting, 
4 Both verbalized 
3 One verbalized 
2 Neither verbalized 
1 Failed 


ime 


To quantify the six steps involved in the Cube 
test [6], Boyd’s method was used [4]. Accordingly, 
making a correct pattern and giving a correct a 
planation of this on step 1 are each given a Weight 
of 5 points, or a total weight of 10 Points. Attain- 
ing a correct pattern and explanation on step 2 js 
given a total score of 5 points; on step 3, 4 points; 
on step 4, 3 points; on step 5, 2 points; on step 6, 
1 point, Hence, because the first 6 designs were 
used in this study, a total score of 60 was POssible 
on the Cube test. 


both concepts abstract 


one concept 


both concepts concrete 


Analysis of the Data 


The schizophrenics and organics were com- 
bined and then were divided into thirds accord- 
ing to the magnitude of their TRS scores. The 
lowest third of the group had TRS scores be- 
low 67, the middle third had scores between 67 
and 74, and the upper third had scores of 75 or 
more. These scores were used to differentiate 
both the schizophrenics and organics into 
thirds. Which third a patient was in depended 
on his TRS score for that day’s testing. Hence, 
because of change in behavior, a patient might 
be in the upper third for Test I and in the low- 
er third for Test II. 


An analysis of variance was made for 14 of 
the 15 tests comprising Test I and Test Il. wool 
each test, estimates of the population variance 
were obtained from variance attributable to di- 
agnosis, level of behavioral accessibility, the in- 
teraction of these two components, and from 
the within-group variance. The Cube test was 
not so treated because not all patients were to 
receive it. On this test, passing was set arbitrar- 
ily at achieving a score of 3 on each of the six 
designs, or a total score of 18. However, if 
total score of 18 was achieved without making 
a score of 3 or more on each design, failure was 
recorded. Such inconsistency as achieving 4 
score of 10 on two of the designs and then fail- 
ing the others was not considered manifestation 
of having learned from the Cube test aids. The 
scores on the Cube test were treated by deter- 
mining the critical ratio between the percentage 
of schizophrenics and organics who failed any 
of the first four designs of the Block Design 
test and passed the Cube test. 


Results 


An analysis of variance was made to deter- 
mine if test scores would be differentiated by 
diagnosis, by levels of behavioral accessibility, 
or by the interaction of these, The relationship 
between mean scores of schizophrenics and OT” 


Banics at each level of accessibility is shown 1? 


e 
igures 1 and 2.1 The mean scores and th 


ues 
*It should be remembered that the score ai 
old different significances for the various SU 


x i ere 

ENR the exception of those reflecting the Wechsler 
cllevue weighted scores. Except in the case 0 

latter scores 


à s nl 
es Figures 1 and 2 are meaningful oe 
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Fig. 1. Mean scores (*indicates mean weighted score) of organics and schizophrenics for upper, 
middle, and lowest thirds of behavorial accessibility on subtests of Test I. 
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Fig. 2. Mean scores (*indicates mean weighted score) of organics and schi 


middle, and lowest thirds of behavorial accessibility on subtests of Test II. žophrenics f 
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Table 2 ; ; 
F Tests of Mean Scores ən Tests I and IL by Levels of Accessibility and by Diagnosis 
s of accessibility Diagnosis 
uo À D LofC Means PL at c 

Up. 3rd Mid. 3rd Low. 3rd forF — Schiz. Organic for 
Test I ' cs , ‘ oe 7 
Information* 8.85 7.35 5.68 1 7.9 ee <5 
Recall I 8.39 7.08 4.34 1 6.79 6.39 i 
Digit Span* 7.29 6.03 4.58 1 6.44 5.17 ; 
Digits Forward 5.80 5.45 4.84 1 5.56 502 és 
Digits Reversed 4.27 3.70 3.13 1 3.85 3,46 i 
Memory-for-Designs 5.68 11.60 12.29 1 7.88 13.39 ši 
Recall II 6.93 5.95 3.50 1 5.77 5.00 i 
Block Designs* 9.24 6.10 4.18 1 7.37 5.05 3 

Binet VQ 108.76 91.63 72.05 1 95.62 83.02 
Test II P , 
Comprehension* | 8.56 7.00 3.59 1 7.12 5.63 i 
Word Pairs I 8.21 5.59 3.07 i 6.56 413 i 
Vocabulary* 9.15 761 Sios ; et pe 5 

Sorting Test 5 

5 5 


5.76 4.76 1.83 4.66 3.68 < 
Word Pairs II 553380 217 < 462 250 < 
* Means derived from Wechsler-Bellevue, I weighted scores, 


and II between Diagnoses and 


a among Levels 
of Behavioral Accessibility 


Between schiz, & 


org. 


Among schizophrenics Among organics 
p: L. J- ME UL üm REE 
Test I m 
etn 3.40% 2.269 Tze 2.40% agos iapa 1.99" ae 
Digit span 2.454% 3.028" 3.56%8 2asee 38%" 
Digits f'wd, 2.86%» 2.624" 3 sone 
Digits rey, 2.82** 2 goes 2.24" 
+ * 
Mem.-for-designs 3.639 29208 1.97 3.71%% 3,69" 
Recall IT ü 3.29%% 3 57e» e 229" 
Block designs 2.40** re 2.11%  3,79w» 2f 4.79" 
Bios Fe an AA 256" dag gaysi sag . ae 
Test II . s 2.44 2.60** 3 soss 6.38%* 241%  2.93* 
+ 
Comprehension Pr 4.11" 
Word pairs I 2.31% taa z 5.95% Agos gojes 2,17" 2.33" 
Vocabulary lg 2.19% 5 owe 2.00 53” 
Sorting test 2.05 


4.349% 6 ogee 2.05” 
e 2.258 a 
Word pairs 11 4.5408 2.968% A T 5.29%+ 
= 1% leye] of confidence; i 
*5 to 2% level of confidence, 


s 
m hind 
be Significantly larger than the witht d 10 


n 
pittance [14]. Exception to this was foU 
Delayed Word Pairs.2 


tha 
i r le 
n-class variance, *Here the of confi 


. 5 z la 
'S procedure was foll -c the interaction variance te vel of Ch, 
case the o towed because in each the within-class variance at the 5% le r varann, 
Interaction variance was found not to a and thus was used as the error Ve oy 
either of 


the F’s was then significant. 
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Intellectual Deficit in Organics and Schizophrenics 


Because the F tests showed significant differ- 
ences in scores among levels of behavioral acces- 
sibility and between diagnoses, ¢ tests? were 
employed to ascertain where the differences lay. 
The magnitudes of the significant ¢’s and their 
corresponding levels of confidence are shown 
in Table 3. 

Of the organics who failed the Block De- 
signs, 60.60% passed the Cube test, while this 
was true for only 53.40 of the schizophre- 
nics. The critical ratio between these percent- 
ages was 7.69, highly significant. 


Discussion of Results 


Inspection of the preceding tables and graphs 
indicates that on all subtests the schizophrenics’ 
scores vary directly with their level of accessi- 
bility. With the exception of two subtests, this 
is also true of the organics’ scores. These data 
serve to substantiate the high degree of rela- 
tionship already established between psychotics’ 
test scores and their behavioral accessibility 
[20]. These results further suggest that re- 
gardless of the ultimate basis for the illness, 
psychotics show a disturbance of thought pro- 
cess that has at its cause a large behavioral or 
functional element. This agrees with the con- 
clusions of Rapaport [19] and others in contra- 
indicating the traditional psychiatric viewpoint 
of a dichotomy of mental disorders into those 
of neurological and those of psychological ori- 
gin. 

Indeed, scores on Recall I, Digits Reversed, 
Recall II, and Wechsler-Bellevue Vocabulary 
seem to reflect only behavioral accessibility and 
do not differentiate organics from schizophre- 
nics at all. This would suggest that findings of 
vulnerability of, for example, digit span [it 2 
15] in organics have been due to behavioral 
inaccessibility rather than specifically to brain 
damage. This further suggests that vocabulary 
cannot be regarded as resistant to encroachment 
by disease process and therefore an absolute in- 
dex to premorbid level of function when vocab- 
ulary is so vulnerable to behavioral inaccessibil- 


SIn deriving these ?’s, the within-class variance 
Was used as the error term. 


because of the significant interaction variance and 
cause of the shape of the curves [25], £ tests were 
Calculated. Those found to be significant ar 
cluded in Table 3. 


e in- 
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ity (viz. Fig. 1). Despite the intimation of 
Allen [1, 2] and others that behavior plays a 
role in intellectual impairment, there still seems 
to be too great a proneness to interpret “organ- 
ic” or “deterioration” tests as evidence of im- 
mutable deficit in attention, retention, etc., 
due solely to brain damage. 

On the other hand, the scores on Informa- 
tion, Block Designs, and Thorndike-Binet Vo- 
cabulary are significantly higher for the schizo- 
phrenics than for the organics. Although these 
results agree with previous studies [1, 2, 13] 
in that Block Designs shows greater deficit in 
organics than does Information or Vocabulary 
(Table 2), the present study indicates that 
when compared with schizopiirenics, the organ- 
ics show deficit on all three of these tests. This 
cannot be accounted for simply on the basis of 
behavioral accessibility, even though the scores 
of both groups on these subtests are highly re- 
lated to it, because on each of these subtests the 
schizophrenics do significantly better at all 
levels of accessibility (Table 3). On Informa- 
tion and Block Designs the superiority of 
schizophrenic scores is less significant at the 
lowest level of accessibility than at the highest 
level. This indicates that, on these two subtests, 
as behavior becomes more inaccessible, the 
schizophrenics’ performance more closely ap- 
proaches that of the organics. Conversely, on 
the Thorndike-Binet Vocabulary the superior- 
ity of the schizophrenics’ scores is inve 
proportionate to accessibility. On this sy 
the schizophrenics’ scores are somewhat 
vulnerable to poor accessibility than 
of the organics. 

The significantly higher scor 
phrenics on these subtests can 
to differences in education, 
ratio for years of educati ni 
i only 0.56. The CR clue two groups 
tion is also insignificant, He 
2.86 exists between the me 
groups, indicating that the or 


rely 

btest 
less 

are those 


dence that age alone would 
difference, especially in al] 
The conclusion, t en 


7 
Vocabulary reflect 
impaired in direct Proporti 
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terference but that are more severely impaired 
by actual brain damage. # 


It is interesting that the Wechsler vocabulary 
completely fails to differentiate the two diagnostic 
groups while the Thorndike-Binet vocabulary does 
so at all levels of accessibility. Derivation of VQ's 
from the Wechsler-Bellevue weighted vocabulary 
scores shows that the Binet vocabulary is more dif- 
ficult for organics than for schizophrenics. The 
schizophrenics’ Wechsler VQ’s are comparable to 
their Binet VQ’s, However, the organics’ Wechsler 
VQ’s are significantly higher than their Binet VQ’s. 
From inspection of the two vocabularies it appears 
that many words in the Binet vocabulary require 
greater elaboration and encompass more abstract 
concepts than do the Wechsler words, The organic 
patient’s felt impotence and his excessive difficulty 
in conveying his thought in accurate verbalization 
[19] could account for the lower score on the Binet 
vocabulary. 

On both Word Pairs I and Word Pairs II the 
schizophrenics do significantly better than the or- 
ganics only at the upper level of behavioral access- 
ibility. This Suggests that organics show intrinsic 
difficulty in the thought Processes of formation of, 
and especially in the retention of, 


Cesses are greatly disrupted by the emotional inter- 
ference of schizophrenia, 

On Digits Forward, Memory-for-Designs, 
prehension, and Sorting test, at t 


shift are dis d : 
and Stheerer 6 CUSSe „by Goldstein 
in Rapaport as, om: ler Buerger-Prinz and Kaila 


aids of the Cube test the organic becomes fixated 
on one element of the design and often perseverates 
that operation in attempting to deal with other 
elements. Hence, he cannot transcend by himself the 
immediate situation and effect relationships which 
lie outside of it. The Cube test aids assist him in 
shifting his attitude so that he can learn to complete 
the tasks independently. On the other hand, it ap 
Pears that the schizophrenic's emotional came 
Prevents him from goal-directed behavior ra 
therefore from recognizing the purpose of the Cu 
test aids and from utilizing them. 


Summary and Conclusions 

Two test batteries were cach administered 7 
42 organics and 85 schizophrenics on two ull 
cessive days. No patient was of less than du 
normal intelligence or over 60 years of yo 

he test data were treated by dividing pene 
tients into thirds according to their TRS aes 
and then analyzing the test scores according t 
variance attributable to diagnosis, to level, of 
behavioral accessibility, and to the interactio 
of these components. : 

Within the limits of this study, the following 
conclusions seem tenable: 

1. The test scores of psychotics primarily j 
flect behavioral inaccessibility rather th a 
intrinsic deficit in the intellectual eT a 
designated to be measured. Organic as We ro- 
schizophrenic disorganization of thought P 
cess is largely due to behavioral i a 

2. Deficits shown on Wechsler-Bellevr 
Vocabulary, Digits Reversed, Recall I, a" ot 
call TI reflect behavioral disturbance an, this 
specifically brain damage. Application © jon, 
Suggests that when used without qualificar 
many “deterioration” tests may measure Pe 
‘oral rather than organic involvement. horn- 

3; Information, Block Designs, and 1 esses 
dike-Binet Vocabulary reflect thought ae 
that are impaired in direct proportion to p 
ioral interference but that are morg See 
impaired, at all levels of accessibility, in in$ 
Ces of actual brain damage. Cube 

4. Organics respond to the aids of oe atti 
test because these aids assist in shift of con the 
allowing the organics to learn to ee al ta 
task. Schizophrenics do not respond as al dis- 
these aids because of greater behavior 
turbance in this area. 
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Use of The Performance Scale of the Wechsler 
Intelligence Scale for Children with 
the Deaf Child 


E. Ellis Graham and Esther Shapiro 


University of Denver 


Most testing services are not Prepared to test 
the deaf because of the scarcity of equipment, 
rarity of occasion, and expense involved. The 
Purpose of this study was to investigate the 
possibility of using the Performance Scale of 
the Wechsler Intelligence Scale For Children 
(WISC) to obtain a valid measure of intelli- 
gence in deaf children, For this purpose, 20 
deaf children were compared with two groups 
of hearing children, 20 in each group. 

Much of the emphasis in the education of 
the deaf has been in Preparing them vocation- 
ally so that they may be self-supporting, Con- 
i o the achievement 


» to find group 
acceptance, to experience Success as individuals, 


tarded [4, 5, 6], the fact that the deaf child 
will eventually have to fit into th 


child’s world makes it imperative that We assess 
his abilities by the same standards that are used 
for the group with which he will compete. 


e hearing 


The WISC, introduced in 1949, includes a 
erformance Scale which seems to lend itself 


omical in that it is part of the standard equip- 
ment. Its measurement of various cognitive 
areas of intelligence for the normal-hearing 
child can provide a comparison with the deaf 
in whom it may be presumed to measure the 
same abilities. For these reasons the authors 
were interested in investigating the possibility 
of using this test with deaf children. 


Procedure 


In order to test the usefulness of the Per- 
formance Scale of the WISC with deaf child- 
ren, three groups were set up. The members of 
Groups II and II, children with normal hear- 
ing, were individually matched according to 
Certain pre-established criteria with the mem- 
bers of Group I, children with marked hearing 
disability, P 

Criteria for matching included hearing, 
physical health, sex, color and nativity, age, an i 
intelligence, Normal hearing was defined simp” 

y as the absence of a known auditory deiei 
deafness was defined as a hearing loss of 60 r 
or greater, in both ears, sustained prior to g 
time of significant language a er’ , 
Good health of all children was established by 
health records, regularity of school attendance 
and observation for apparent handicaps. a i ha 
girls and 11 boys were American-born ee 
children, whose ages ranged between six a 
three months and twelve years two ae 
Subjects were matched according to age wit 
three-month periods. 

The Goodenough Draw-A-Man Test (D 
AM) was used as the basis for matching ! se- 
viduals with respect to IQ. This aaa 
lected Primarily because of its simplicity; ie 
in content and in administration, its qV 
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Use of the IFISC with the Deaf Child 


scorability, and because it does not make use of 
material included in the WISC. For the deaf 
group, the teacher or examiner requested that 
the child draw a Picture of a man, the best 
Picture that he could. As some of the younger 
deaf children did not understand these direc- 
tions, the word MAN was printed on the 
blackboard in an enclosed frame, thus indicat- 
ing to the child that he was to draw a picture. 
Standard directions [1] were given to the nor- 
mal-hearing groups. The tests were scored and 
checked by two competent testers. In the case 
of disagreement, the papers were discarded. 
The IQ range was from 74 to 122 for the total 
number of subjects, Matching on the DAM 
was done within plus or minus five points, the 
probable error, as determined by Goodenough 
for her test [1 h 

The WISC Performance Scale was adminis- 
tered individually to the members of Groups I 
and IT through Pantomime instructions, Each 
child in the nonhearing group was introduced 
to the examiner by the teacher and told that he 
was going to spend some time with the examin- 
er and play games, The hearing children were 
similarly introduced and told that the examiner 
wished to talk with them and play some games. 
The examiner instructed them that part of the 
game was that they must not talk and that if 
they watched closely, they would be able to 
understand what they should do, It was the 
examiner’s impression that the children consid- 
ered it a privilege to be called for testing and 
that rapport in all Cases was good. 

No difficulty was encountered in the admin- 
istration of the Block Design, Object Assem- 
since these appeared 


ed out the missing parts in the first two pic- 
tures; 


Arrangement (designed for subjects under 
Cight years of age) and the demonstration set 
Were presented to Groups T and II. The dem- 
"stration cards were 
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modified for Groups I and II, since the exam- 
iner could find no way of Preventing the child- 
ren from lifting their pencils from the paper. 
Accordingly, this misdemeanor was not penal- 
ized. 

The subjects in Group II] Were introduced 
to the examiner either by the examiner or the 
teacher, and were given the WISC in accord- 
ance with the standardized instructions, The 
sixty WISC’s were scored by the examiner in 
strict compliance with the scoring techniques 
[7], except for the modifications mentioned, 


Table 1 
Mean Scaled Scores 
Test Group Group Group 
I II Il 
*Total WISC (Performance) 96.1 95.5 101.15 
Picture Completion 5 9.35 9.3 
Picture Arrangement 8.8 G5 11.6 
Object Assembly 10.75 9.9 9.7 
Block Design 9.85 9.95 9.45 
Coding 8.7 8.5 10.75 
Mazes 8.9 8.85 102 


* Total here reported as IQ rather than sealed score, 


Results and Discussion 


Inspection of Table 1 shows tha 
tent difference occurs in the 
the various subtests in favor of 
When Group II is compared w 


statistically significant differen 
Group IT] 


t no consis- 
mean scores of 
any one group. 
ith Group III, 


ces in favor of 
are found for total Perfo 


Í rmance 
Scale and three of its subtests : Picture Ar. 
rangement, Coding, and Mazes. Between 
Groups I and IIT the total Performance Scale 
Table 2 
Significance of Differences between Groups (t) 
Test Groups Groups Groups 
Tand Ir I and Tand 
Ill IH 
t t 
Total WIsc 
(Performance) 
icture Completion a E "he 
Picture Arrangement , CA a re 
Object Assembly 11 Ti yi 
Block Design a i > 
Coding 14 46 66 
azes a tn “Py 
-08 2.0* i 
B- Significant at hey level z 
Significant at 1% level. 
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is significantly higher for Group III, as are the 
scores for Picture Arrangement, Coding, and 
Mazes. Group I is significantly higher in per- 
formance on Object Assembly than is Group 
UL; 


Table 2 indicates that the differences be- 
tween the performances of Groups I and II are 
not statistically significant. It will be noted 
that pantomime instructions were used in both 
these groups in an attempt to standardize the 
method of administration. However, the nor- 
mal-hearing child may be handicapped in that 
he is not accustomed to expressing himself in 
pantomime or to interpreting pantomime direc- 
tions given by others. This method, therefore, 
creates an artificial situation for him. For the 
deaf child, on the other hand, pantomime is a 
more natural means of expression; he has learn- 
ed through the years to make himself under- 
stood by gestures and to understand others by 
watching for cues in facial and bodily express- 
ions [2]. Group III was included to control 
the artifact which the pantomime instructions 
presented for the hearing child, and because the 
WISC was standardized with oral directions. 
Knowing that the three groups were equated 
in intelligence according to the Goodenough 
DAM, we cannot assume that Group III was 
brighter than either of the other groups. Conse- 
quently, it would seem that the difference in 
performance resulted from the method of 
administration. It is possible that the time fac- 
tor, which operated in five of the six subtests, 
may have been influential in accounting for the 
differences between the groups receiving pan- 
tomime and verbal directions. Hiskey [3] be- 
lieves it is unfair to include speed tests in a 
scale for deaf children as the concept of speed 

is difficult for the young deaf child to grasp. 
In general, this was found to be true, although 


E. Ellis Graham and Esther Shapiro 


in several instances the subjects seemed to 
understand. 

Since pantomime seems inseperable from — 
deafness, its effect must be considered in any 
test to be used for the deaf. Consequently, al- 
though the Performance Scale of the WISC as 
discussed in this study cannot be used validly 
to obtain a measure of intelligence for deaf 
children, it seems feasible that a correction fac- 
tor which will nullify the effects of the panto- 
mime instructions could be obtained. If such a 
factor can be established, then the test should 
be doubly valuable in assessing the deaf child’s 
intellectual functioning. As it is, the test can 


be administered via pantomime as a crude meas- 
ure, 
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Books 


Barker, Roger G., Wright, Beatrice A., Meyerson, 
Lec, & Gonick, Mollie R. Adjustment to physical 
handicap and illness: a survey of the social psy- 
chology of physique and disability. (Rev. Ed.) 
Soc. Sci. Res, Coun. Bull. No. 55, Rev. 1954. Pp. 
xvi -+ 440. (paper) $2.00. 


The effect of physical handicaps, cosmetic and 
functional, on attitudes and personality is well 
‘nown, although generally little understood. The 
foreword to the first edition of this important sur- 
vey quotes an illuminating passage from Sir Francis 

acon on the topic written over 300 years ago. The 
Soma-psyche relations have recently had much elab- 
oration in the various fields of psychosomatic medi- 
cine, This publication stresses the somatopsycholo- 
Bical relations of physique and behavior with spe- 
cial reference to theory, research, and practice. 
Well-organized treatment is evident in the carefully 
Outlined table of contents, extensive topical bibli- 
graphy, careful author index, and detailed subject 
index. The volume is much too good to receive only 
Casual comment. It should be read with studious 
Care. The principle of adjustment fo handicap rath- 
er than adjustment of the handicapped is clearly 
revealed as a significant reorientation which re- 
Ceives increasingly wide acceptance.—E, A. D. 


Goldhamer, Herbert, & Marshall, Andrew W. 
Psychosis and civilization: two studies in the fre- 


quency of mental disease. Glencoe, Ill.: The Free 
Press, 1953. Pp. 126. $4.00. 


This research monograph offers the best answer 
which the reviewer has yet seen to the often-asked 
question, “Is mental disorder on the increase ?” The 
first of the two studies reported is based on a critical 
historical and statistical analysis of data covering 
a hundred-year period. It answers the question con- 
vincingly, “No.” The second study, less cheerful in 
its conclusion, estimates that a person today has 1 


Note.—The reviews were prepared by the Editor 


and the Associate Editors, who may be identified by 
their initials, 
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chance in 20 of being affected by serious mental 
disorder by the age of 45, and 1 chance in 10 by 
the age of 65. The entire monograph deserves the 
careful attention of psychologists.—L. F. S. 


Karpf, Fay B. The psychology and psychotherapy 
of Otto Rank. New York: Philosophical Library, 
1953. Pp. xii -+ 129. $3.00. 


This is a brief summary and sympathetic critique 
of Rank’s theoretical contributions to psychoanalysis 
and psychology. The treatment is integrative and 
interpretative rather than narrowly factual, and the 
book makes pleasant and thought-provoking reading. 
—IV. A. H. 


Kessler, Henry H. Rehabilitation of the physically 
handicapped, (Rev. Ed.) New York: Columbia 
Univer. Press, 1953. Pp. xv + 275. $4.00. 


The five years that have elapsed since the pub- 
lication of the first edition of this book have shown 
us the continued need for the total utilization of 
manpower. There has been a steady growth in the 
recognition of the value and importance of rehabili- 
tation. In the second edition Dr. Kessler has taken 
care to bring the illustrative material and tables up 
to date. There has been a complete rewriting of 
some of the chapters; for example, the one on voca- 
tional training, and the one on the blind and the 
deaf. The book should continue to occupy its im- 
portant position as a source book for those working 
with the mentally and physically handicapped. 
There is an excellent index and a list of major 
centers and agencies for the handicapped.—B, M.L. 


Lindquist, E. F. Design and ana. 


in psychology and education, 
Mifflin, 1953, Pp. 


lysis of experiments 
Boston: Hou h 
k : għton 
xix + 393, $6.50. 

Lindquist’s most recent textbook on design is es- 
sentially a modernized, more sophisticated version 
of his widely-used Statistical Analysis in Educa- 
tional Research (1940). Six main types of design 
are considered in detail, together with i i 

s A their 

and mixtures: tee 


simple-randomizea tre 
1 A atments b 
levels, treatments by subjects, random replications 
factorial, and groups-within. à ; 


-treatments. The au- 
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thor’s plan, to begin the exposition of each design 
with basic principles and matierabcal agen 
instead of coacrete illustrations, makes A j 
reading but prevents the student from loo iNe ‘or 
mere recipes. Ample exercises follow each c D 
The book is best used as a text in conjunction wilh 
competent class instruction. It can also serve as P 
stimulating reference for psychologists with a goo 
command of basic statistics.—L. F. S. 


Mowrer, O. Hobart. (Ed.) Psychotherapy: theory 
and research. New York: Ronald Press, 1953. Pp. 
xviii + 700. $10.00. 


Twenty-two psychologists collaborated in the 
preparation of this impressive volume which com- 
bines eight chapters of e says on methods and the- 
ory, 201 pages, with eleven chapters, 455 pages, on 
research techniques’ and findings. The chapters on 
theory vary greatly in their nature, but one cannot 
imply that they are uneven in quality; each is a 
good and typical example of its author’s work. To 
refer to only a few: May gracefully relates therapy 
to its philosophical background; Rogers illustrates 
some of his convictions with excerpts from inter- 
views; Mowrer presents a theory of neurosis and 
therapy synoptically. The most notable character- 
istic of the volume, in contrast with most other 
books on psychotherapy, is that it devotes more 
than two-thirds of its length to research studies, All 
of the materials are meaty. Some are summaries or 
extensions of research programs already reported, 
as in Seeman and Raskin’s chapter on research in 
client-centered therapy, and in Dollard’s and Mow- 
rer’s separate sections on measuring tension in writ- 
ten documents. There are methodological contribu- 
tions by Mowrer, Cronbach, McQuitty, and others. 
Research results not reported elsewhere i 
dies of verbal behavior and of tension cl 
ing psychotherapy, carried out by Mowrer and his 
students. The volume as a whole is hard to c 
gorize. It is not exactly a text, a treatise, or a re- 
search report, but is something of all three. It is 
decidedly worth reading, by psychologists and by 
their advanced students.—L. F. §. 


nelude stu- 
hanges dur- 


ate- 


Overholser, Winfred. The psychiatrist and the law. 


New York: Harcourt, Brace, 1953, Pp. x + 147. 
$3.50. 


In their roles both as citizens an 
psychologists will find this little 
and informative, Winner of the I 
for the most worthy “contrib 
ment of the relations of La 
presents a provocative social 
ot the law as an institution, 
the legal issues izvolved in the 
tional maintenance, a 
chiatric hospitals, 


d as professionals, 
book stimulating 
saac Ray Award 
ution to the improve- 
w and Psychiatry,” it 
Psychological analysis 
trenchantly examines 
commitment, institu- 
nd release of patients in psy- 
and discusses with great insight 
the functions and problems of the student of behay- 
ior as an expert witness. Dr. Overholser writes out 
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. Iş 
of rich personal experience, with a ag ae 
large familiarity with legal precedents an eal 
vant literature in the history of both pen d 
law, and from a broad and humane point pe 
His contribution to interdisciplinary U a et 
is considerable, and his illustration of how Pe aa 
fession deeply concerned with human am F ofl 
usefully and constructively criticize anot he seats 
vides a model to which the other sigan keen 
might well pay heed. It is regrettable that Meen 
thinking was not directed toward those lega and of 
bearing on interprofessional relationships, @ his rë 
wonders if he does not protest too much in mental 
peated insistence that all legally relevant 
states constitute medical questions.—E. J. $. 


erit 


: b 
Podolsky, Edward. (Ed.) Encyclopedia of 4 1953 


tions. New York: Philosophical Library, 
Pp. ix + 550. $10.00. 


This volume is the result of the efforts ee 
one physicians most of whom are payen icles 
seven psychologists, and one chemist. a the! 
(or original papers, as Alexandra Adler cal ‘ine t0 
in a foreword) vary in length from a single e de 
many pages. Twenty-six pages, for example, topi 
voted to the psychopathic personality. The am 
are mostly well-known symptoms and sy? rms a 
There are also definitions of less familiar te am 
well as discussions of a few basic concepts., ic 
ple of topics includes aboiement, anti-Semit pa j 
tudes, anxiety states, disorientation of body i tive 
coarctation, folie à deux, gelasmus, nas yio! 
group behavior, nuns’ melancholy, orality, ization 
during puberty, and sophomania. The orem incl, 
within the topics varies greatly. Some topics qrt 
long cases, a few contain tables, diagrar ne 
Rorschach summaries, Bibliographies and Many We 
to other publications are extremely rare. i H 
ticles deal with theoretical explanations ° jn y 
nomena. The writing style is quite readablei s ” n 
almost popular in nature. The reviewer "reels i 
index or lengthy table of contents and e 0 ye 
absence of it will reduce efficiency in the a orent” 
book. There also seem to be few conte ie 
Some of the topics represent an excellent © 
the phenomena—F, McK. 


atti” 


al 
jde g 
Reid, Joseph H., & Hagan, Helen R. ha Be, 
treatment of emotionally disturbed chile oh jn 
York: Child Welfare League of Amer 
1952. Pp. ix + 313. $3.50. 
o 
In the more severe behavior disturbance dt 0” 
dren, and those where family life is ae of ext j 
to recovery at home, therapeutic ae i 
familial procedures have been often Us 
study reports a descriptive survey of vide Spt! 
dential treatment centers, in order to pro sew” / 
ance in establishing similar programs enf Sy 
Five of these centers represent social. ai sy? 
grams, and seven are essentially medica 


twelve id? 
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atric), representing the major developments in this 
field in the United States. Three are supported by 
public funds and nine by private and community 
funds, one primarily by patient fees. The study de- 
liberately avoids evaluation, concentrating instead 
on such issues as organization, plant and grounds, 
intake policies and procedures, population, staff, 
treatment program, costs, personnel training. The 
report is factually informing as to resources and 
practices. Professional readers will sense numerous 
implications and will no doubt derive evaluations 
of their own. Psychologists will be specially interest- 
ed in the opportunities for service afforded and the 
conditions of professional and interprofessional col- 
laboration.—E. A. D. 


Sullivan, Harry Stack. The interpersonal theory of 
psychiatry. New York: Norton, 1953. Pp. xviii + 
393, $5.00. 


Harry Stack Sullivan's approach to psychiatry, 
as expressed in The Interpersonal Theory of Psy- 
chiatry, will probably be more acceptable to psy- 
chologists than that of any other well-known psy- 
chiatrist, He arrived at his destination via clinical 
research in schizophrenia and analytic therapy in 
the psychoneuroses; the vehicles were psychoanaly- 
sis, Adolph Meyer's psychobiology, field theory, 
and social psychology. The result is an eclecticism 
that is dynamic and significant. Sullivan rejects the 
concept of psychiatry as merely the study and treat- 
ment of abnormal behavior; much more important, 
as far as he is concerned, is the study of interper- 
sonal relationships. This work is an edited version 
of Sullivan’s lectures and notebooks from 1946 to 
1949, the year of his death. Since his lectures were 
More sparkling than his writing, this volume, fre- 
quently in colloquial vein, makes interesting and 
relatively easy reading.—M. K. 


Whiting, John W. M., & Child, Irvin L. Child 
training and personality: a cross-cultural study. 
New Haven: Yale Univer. Press, 1953. Pp. vii 
+ 353. $5.00. 


An important research report on the interrelations 
between personality and culture as seen in data 
about 75 societies, obtained mainly from the Human 
Relations Area Files of the Institute of Human Re- 
lations. The orientation is toward the testing of 
general hypotheses, drawn from psychoanalysis and 
general behavior theory, rather than toward the 
understanding of any one society. A correlational 
method is used, each culture being considered as a 
unit. The results, which should be examined in de- 
tail, give little support to some hypotheses and much 
to others. In general, they confirm the need to di- 
vide broad psychoanalytic formulations into more 
detailed hypotheses restated in terms of general 
ehavior theory. No one should teach a course or 
Write a book on personality without considering the 
evidence preesnted here—L. F. S. 


401 


Tests ‘ 


Bennett, George K?, & Gelink, Marjorie. Short Eth- 
ployment Tests, 1953 Manual. New York: Psy- 
chological Corp., 1953. Pp. 10. 35¢. 


The battery of three five-minute tests for clerical 
applicants—verbal, numerical, and clerical aptitude 
—was issued in 1951 with a preliminary manual (see 
J. consult. Psychol., 1952, 16, 159). The new man- 
ual contains evidence of the validities of the tests 
in terms of various relevant criteria, obtained from 
six different businesses. There are also tables of 
reliabilities, intercorrelations, relations to other tests, 
and norms.—L. F. S. 


Bruce, Martin M. Sales Comprehension Test, Form 
M. Adults. 1 form. Untimed, (20) min. Test 
booklet (20¢), with manual, pp. 8; specimen set 


($1.00). 


Business Judgement Test. Adults. 1 form. Un- 


timed, (15) min. Test booklet (15¢), with man- 
ual, pp. 4; specimen set (75¢). 


Sales Motivation Inventory. Adults. 1 form. 
Untimed, (30) min. Test booklet (15¢), with 
manual, pp. 4; specimen set (75¢). New York 9 
(624 E. 20 St.): Author, 1953, 


These three business tests are of special interest 
because of the author’s explicit plan to report data 
according to the recommendations of the APA Com- 
mittee on Test Standards. As a result, the manuals 
are more informative than are many such docu- 
ments, and candidly show the limitations as well as 
the values of the tests. The Sales Comprehension 
Test is the best-developed of the three, being based 
on item analyses and other studies carried out over 
a period of several years. It discriminates salesmen 
and nonsalesmen successfully, and has some rela- 
tionship to success in selling. The other two tests 
are not as fully developed, but their manuals show 
some preliminary evidence of usefulness, and are 
free from undue claims.—L. F. §, a 


Wood, Hugh B. Behavior Preference Record. 3 ley- 
els, Gr. 4-6, 7-9, 10-12. 2 forms at each level 
Untimed, (30-45) min. IBM i 
scoring. Test booklet (8¢); 
Scoreze (7¢) 
(35¢). 
1953. 


» Scoreze, or hand 

answer sheet (4¢) - 

Bog 3 

oe aie mano PP- 16; specimen set 
s Angeles: California $ 

a Test Bureau, 


. This questionnaire presents 15 to 20 
interpupil situations 


described 
lowed with 


AS in school settings, each fol- 
multiple-choice alternatives 
sponses to “what would you do?” 


is scored for five variables which are called 

operation, friendliness, integrity ee 
responsibility, and for a critical | 
sented as an index of the 
indicated in the “because” 


for re- 
and “because.” It 


leadership, and 
al thinking score pre- 


degree of rationaiization 
choices. Statistical data 
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are given fully, including (for the Grade 10 to = 
forms), trait reliabilities ranging from -72 to .90, 
correlations with teacher’s ratings“ ranging from .46 
to .78, and trait intercorrelations from —.03 to E 
-34. Norms are based on “some. seventeen hundred 
cases, which are unspecified. with respect to levels 
and forms. While the blank may evoke some useful 
thinking about the social characteristics of pupils, 
it suffers from numerous faults. The Prestige values 
of the responses were not controlled. As in all such 
short questionnaires, radically different interpreta- 
tions from “average” to “yery high” may be drawn 
from scores which differ by as little as 3 points 
when the standard error of measurement is as great 
as 2.8 points.—L. F, S, 


Books Received 


Berkman, Tessie D, 


ractice of social workers in 
psychiatric hospitals and clinics. New York (1860 
Broadway): Amer. Assoc, of Psychiatric Social 


Workers, 1953, Pp. ix + 158. (paper) $2.00. 


Buros, Oscar Krisen. (Ed.) The fourth mental mea- 
surements yearbook. Highland Park, N. J. (220 


Montgomery St.) ; Gryphon Press, 1953, Pp. xxiv 
+ 1163. $18.00. 


Hammond, Kenneth R., & Allen, 
Writing clinical reports, 
Hall, 1953. Pp, xii -+ 235, 


Jeremiah M, Jr. 
New York: Prentice- 
$5.35. 


Heiman, Marcel. (Ed.) Psychoanalysis and social 
work. New York: International Universities 
Press, 1953. Pp. xiv + 346. $5.00. 


Kubie, Susan H., & Landau, Gertrude. Group work 
with the aged. New York: International Univer- 
sities Press, 1953, Pp. 214. $3.50, 
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aià . s ta- A 
Lacey, Oliver L. Statistical methods in experimen’ 


tion. New York: Macmillan, 1953, Pp. xi -++ 24% 
$4.50. 


al 
Lindgren, Henry Clay. The psychology of ee 
and social adjustment. New York: Ame 
Book Co., 1953. Pp. ix + 481. $4.50. 


à Y.: 
Moreno, J. L. Who shall survive? Beacon, i 
Beacon House, 1953. Pp. cxiv + 763. $10.00. 


x New 
Naumburg, Margaret. Psychoneurotic art. 


48. 
York: Grune & Stratton, 1953. Pp. x + 1 
$6.75. 


Peters, R. S. (Ed.) Brett's history of peyeho 
New York: Macmillan, 1953. Pp. 742. $7.50. 


: F New 
Riese, Walther. The conception of disease. 0 


coe 1206 
York: Philosophical Library, 1953. Pp iv + 
$3.75, 


ork: 
Roheim, Geza. The gates of the dream. New 5 
International Universities Press, 1952. Pp. 
554. $10.00. 


s you 


abine, Paul E. Atoms, men and God. New 3.75 


Philosophical Library, 1953, Pp, x + 256: 


«nent 
Townsend, John C. Introduction to rea i 
method. New York: McGraw-Hill, 1953. 
+ 220. $4.00. 
Westwood, Gordon. 
New York: Dutton, 


Woolf, Maurice 


dent personnel 
Hill, 


al 
Society and the homose*™ 
1953. Pp. 191. $3.00. 


D., & Woolf, Jeanne A. 
brogram. New York: 


McGr* 
1953. Pp. ix + 416. $5.00. 


The stu" ; 


- 


Journal of Consulting Psychology 
Vol. 17, No. 6, 1953 


Ranking Bellevue Subtest Scores 


for Diagnostic Purposes’ 


Joseph Jastak 


University of Delaware? 


One of the features of the Bellevue scale is 
the diagnostic significance of rank patterns of 
the 11 subtests. Wechsler [4] has found that 
the pattern of sigma deviations of individual 
subtest scores from the mean is to some extent 
related to psychiatric disease entities. His 
schizophrenics, for example, rank high in in- 
formation and vocabulary. They rank low in 
picture completion and similarities. His psy- 
chopaths rate high in object assembly and pic- 
ture arrangement, low in information and 
arithmetic. Wechsler gives sign lists for neu- 
rotic, schizophrenic, organic, psychopathic, and 
mentally defective patients [4, pp. 150-152]. 
Clinical impressions substantially agree with 
the ability patterning reported by Wechsler. 

owever, there is no objective way of applying 
his sign lists to individual case records. If an 
objective method were applied, the signs would 


not withstand the rigors of clinical and experi- 
mental testing. 


This study was undertaken to find the pos- 
sible reasons why the sign lists fail. We assume, 
along with Wechsler, that ability ranks may 


1This study is a by-product of more extensive re- 
Search on mental diagnosis undertaken with fi- 
nancial aid from the Kate Jackson Anthony Foun- 
dation of Lewiston, Maine. The Foundation’s gener- 
ous support is here gratefully acknowledged. 

e numerous calculations were facilitated by 
the use of a Monroe automatic calculator which was 
made available to the author through the efforts of 
the Rev. H. E. Hammond of Old Swedes Church 
and the Christina Community Center, Wilmington, 
Delaware. 

A modification of this paper was presented at the 
annual meeting of the Delaware Psychological As- 
Sociation on October 13, 1952, 


?The psychometric data for this study were as- 
Sembled and tabulated while the author was chief 
Psychologist at the Delaware State Hospital and 

ental Hygiene Clinic, Farnhurst, Delaware, 
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provide a sound basis for the study of person- 
ality differences [1]. We also assume that such 
differences are measurable, and that their 
measures may be clinically useful, 


Problems and Methods 


The measurement of subtest dispersion has 
two aspects: (a) the rank orders in which 
measured abilities occur and (b) the extent 
to which their scores deviate from ap 
reference point. Our study is confined to the 
first of the two aspects. To measure rank or- 
ders and their patterning, we have found the 
rank-difference correlation method (rho) most 
convenient. The rho method has a number of 
advantages. It avoids dealing with plus and 
minus entries. Its coefficient directly represents 
the multiple relationships between subtests 
without intervening reference points like the 
mean or vocabulary scores. The ranks are in- 
dependent of ability levels. Inferior and supe- 
rior intellects may have similar or identical 
ranks. Ranking is also independent of the de- 
gree of discrepancies between scores which can 
be measured by other means. The rho makes 
the comparison of individual records with each 


other or with those of a group a relati 
simple matter, and 


tion. Its probab 
lished. 


articular 


J F vely 
it facilitates cross valida- 


le error is fairly well estab- 


Some years ago, we analyzed the Wechsler- 
Bellevue records of several 


samplings by the rho meth 
applicants, state hospital 


rotic and Psychotic Patients <£ 
sampled in fairs} 
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Table 1 


i i k Veighted Score Means for 
i ts (rno’s) of Subtest Ranks of Bellevue V 
ae silage Diagnostic Groups Studied by Rapaport 


Groups N 1 2 3 4 5 A 7 
7 2 7 é a 
1. Unclassified schizophrenics 37 76 6 n 7 s s 
2. Paranoid schizophrenics 26 ; q G 
3. Paranoid condition and a . a 
simple schizophrenics 22 i a6 7 a 
4. Preschizophrenics 32 92 #5 
5. Depressives 31 a 
6. Neurotics 59 
7. Police patrols 54 


than .83. Ranking of subtests failed to differ- 
entiate between normal and abnormal groups 
or between any two abnormal groups. 

Then we ranked the Bellevue records of 
studies published by others and got results very 
much like our own. The intercorrelations 
tended to be significantly positive with few 
exceptions. The individual coefficients varied 
more with size and homogeneity of the group 
than with the diagnosis. As an example, Table 
1 contains the correlation matrix for the 
weighted score ranks of seven diagnostic groups 
published by Rapaport [3]. 

The high positive intercorrelations between 
Rapaport’s groups support our findings con- 
cerning pattern similarity in highly different 
groups. When Rapaport’s main groups are 
split into their subcomponents, only his simple 
schizophrenics (N=9) and his maladjusted 
patrols (N=9) deviate from the trend of high 
positive correlations. A comparison of Rapa- 
port’s seven group patterns with five of our 
own patterns gave 35 rho’s ranging from .66 
to .95, indicating that Bellevue subtest pat- 
terns tend to be similar irrespective of pl 

. time, and population sampling. We cons 
the bunching of rho’s at the high positive 
unusual, since there j 
they should not vary 
sible range from min 


ace, 
ider 
end 
s no logical reason why 
through their entire pos- 
us one to plus one. 

If a schizophrenic and a psychopathic patient 
have antithetic ability ranks, as js often re- 
ported and assumed to be the case, then the 
rho coefficient between their score ranks should 
be high and negative. This does not appear to 
be the case. In view of such puzzling results we 
have asked ourselves the following questions. 
Is the idea of differentiating ability ranks be- 
tween diagnostic groups a false one? Are our 


methods of measuring ability patterns iara 
quate? Are external criteria of grouping ing 
reliable? Should we look for factors soe 98 
meaningful ability patterns? Is there per ee 
something in the norms of the Bellevue S€ 
that makes ability ranks so uniform? hs 
First, let us see to what an extent m 
ler’s own sign lists are correlated. In Table H 
we present the matrix of rho’s for ieme d 
agnostic groups described in Wechsler’s 


Table 2 eed 
Intercorrelations (rho’s) of Wechsler’s Rae 
Sign Lists for Five Diagnostic Groups 
8 o 
8 P| m 
E 2 2 a pA 
4 3 ey ad 
A a l kİūĉćĉĉ¢ 
33 
Organic 37 63 06 3 
Schizophrenic 65 -.13 ‘nn 
Neurotic -14 41 


Psychopathic 


*[4, pp. 150-152) 


of 
In Table 2 we see that only three out ° hes? 


. rae ous that 
entries are significantly positive and the 


: : a t 
to the neurotic and amare Pe crore? 
Most of the rho’s are not appreciably 4 
from zero which is as it should be. ov 


£ 
To find out why Rapaport’s and oige 
rho’s are so high, we have made. five apse a 
analyses of the test ranks of five ae ant 
have used the Jastak-Bijou ee elle” ig 
Reading test [2] in addition to ae: 12 rane, 
subtests. This gives us 12 subtests an 


ji 
ana 
for each group and each method © 


| 
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The five groups were: (a) Delaware State 
Hospital employees (attendants, office clerks, 
matrons, occupational aides, technicians, main- 
tenance and recreation workers), (b) patients 
diagnosed as psychoneurotic, (c) patients di- 
agnosed as manic-depressive, (d) patients di- 
agnosed as schizophrenic, and (e) patients di- 
agnosed as psychotic because of organic brain 
disease. No alcoholics were included in the 
group of organic cases. The ranges, means, and 
Standard deviations of the ages of our groups 
are shown in Table 3. There are 80 cases in 
each group, 40 males and 40 females, except in 
the organic group which has 40 males and 34 
females, a total of 7+ cases. 


Table 3 


Means, Standard Deviations, and Ranges of 
Ages in Diagnostic Groups 


Range M SD 


Diagnostic group N 
Nonpsychotic 
Male +0 18-68 35.02 13.42 
Female +0 19-58 32.60 11.06 
Neurotic 
Male 40 19-65 32.40 11.00 
Female 40 20-64 36.78 12.39 
Manic-depressive 
Male 40 18-67 38.82 13.69 
Female 40 20-69 41.25 12.85 
Schizophrenic 
Male 40 17-47 30.25 7.26 
Female 40 20-68 33.10 9.89 
Organic 
Male 40 19-77 43.32 15.65 
Female 34 18-67 43.94 11.33 


Total Number 394 


The results of our five groups were an- 
alyzed in the following ways: 

l. Weighted score method. Bellevue 
weighted scores of each subtest were averaged 
for each group. The obtained averages were 
ranked according to size from highest (rank 
1) to lowest (rank 12). The resulting rank 
orders were then correlated by the rho method. 
The use of weighted scores makes the results 
entirely dependent on Wechsler’s normative 
universe without any known controls. 

2. Quotient method. The weighted score of 
each subtest for every person was multiplied 

y five. A quotient corresponding to this pro- 
duct was found in Wechsler’s IQ Tables for 
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verbal or performances tests in the appropriate 
age column. ‘he means of the quotients for 
cach group were calculated, ranked, and cor- 
related as before. This method depends on 
Wechsler's norms, but introduces age control 
since quotients tend to neutralize changes due 
to the age factor. 

3. Independent sampling method with no 
controls. For this method we calculated the 
average raw scores on each subtest obtained 
by 1,241 individuals. Of these, 329 were state 
hospital employees, 169 psychoneurotic pa- 
tients, 181 nonpsychotic patients, 101 patients 
of unknown diagnosis, and 461 psychotic pa- 
tients of all kinds. The mean raw scores on 
each subtest of our five experimental groups 
were compared with the corresponding subtest 
means of the total group by sigma deviations, 
The latter were ranked in order from largest 
plus to largest minus deviation, or from largest 
plus to smallest plus deviation, or from small- 
est minus to largest minus deviation. The re- 
sulting ranks were correlated with each other, 
This method is independent of Wechsler’s test 
norms. 

4. Independent sampling method with age 
control. In this step we divided the 1,241 cases 
into four groups according to age: 440 cases 
from 17 to 29 years, 330 cases from 30 to 39 
years, 273 cases from 40 to 51 years, and 198 
cases from 52 to 77 years. We computed the 
mean raw scores for each subtest and 
group. Then we found the differences betw 
these means and those of our five groups sepa- 
rated by age, and divided them by the sigmas 
of the original age groups. The obtained ratios 
were averaged, ranked, and correlated with 
each other in each of the five groups. This meth- 
od is independent of Wechsler’s norms and, 
in addition, tends to control roughly the most 
tse ci Te ar 
groups of varying age lex Ptr përsong " 

5 Se eae AS vels and thereby em- 
Phasizes the residual relationships du 
sonality differences 


5; Independent 


age 
een 


© to per- 


norms from which si 
culated. These 
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related by the rho method. This ie 
should neutralize any sex differences whic! 
might exist in ability ranks. 


Results 


In reporting results, male and female groups 
will be treated separately through all steps. 
This will permit us to evolve male and female 
patterns if such should be justified. Also, if in 
the course of the analysis, the observed changes 
are parallel for both sexes, our conclusions con- 
cerning the conditions under which pattern 
analysis is most effective will have greater 
weight than they would have if observed in 
one group only. The results of the weighted 
score method are presented in Table 4. 


Table 4 
Correlation Coefficients (tho’s) of Subtest Ranks 
of Bellevue Weighted Scores for Five 
Diagnostic Groups* 


H 2 
E 
Š 3 è g E 
o a a a © 
Male 
Employees 77 62 6 29 
Neurotic 80 89 65 
Manic-depressive 92 76% 
Schizophrenic 81 
Female 
Employees «12 -18 14 .07 
Neurotic .82 +83 88 
Manic-depressive 89 .91 
Schizophrenic .85 


* For males, N=200, 40 in each group; 


for females, 
N=194, 40 in each group except for 34 in or 


ganic group. 


The matrix of Table 4 has significantly posi- 
tive rho’s in 15 out of 20 cells. The ability 
ranks of female employees are apparently dif- 
ferent from those of the other female groups. 
The patterns of male employees and organic 
Patients are also different. We will consider 
tho’s of .40 and below not significantly dif- 
ferent from zero, The coefficients of neurotic 
and psychotic groups for both sexes are so 
highly positive that their test ranks cannot be 
clearly distinguished from each other. 

The rho’s of the quotient method are given 


e 5. The values of Table 5 are general- 
ly somewhat smaller than are those of Table 4. 
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Table 5 r 
Correlation Coefficients (rho’s) of Subtest Ranks o 
Bellevue Quotients for Five Diagnostic Groups 


3 
é v 
e $ 3 
s 3 g 5 
2 £ 5 É 
ö Z a o 
Male 
Employees 72 456 34 eo | 
Neurotic -76 -77 i 
Manic-depressive .85 = 
Schizophrenic s 
Female i3 
Employees :25 —.15 -.01 “ah 
Neurotic 74 73 z 
Manic-depressive 94 77 
Schizophrenic ad 


However, they are still significantly positiv® 
in 14 of 20 cells. The relationship bewi 
male employees and schizophrenics has ð 
clined sufficiently to permit the separation on 
the two patterns. In other respects, the qY 5 
tient method yields similar rank orders 1° 
neurotics and psychotics of both sexes. 

The results of Table 6 were obtained am, 
our third analysis, the independent sampling 
method with no age or sex control. re 
efficients of Table 6 are, with one exceptio’ 
considerably lower than those of Table 4 of °° 
The relationships between employee and a 
tient ranks have become negative in six 0U 


Table 6 


; of 
A ks 
Correlation Coefficients (tho’s) of Subtest Ran 


j ips 
Bellevue Raw Scores for Five Diagnostic Grou 
E | 
FA 2 | 
A 8 o ! 
v Dei 24 
5 2 3 3 4 
[e] Z a ak | 
Male ‘i 48 
Employees 44 26 E 12 
Neurotic .09 a „56 
Manic-depressive è: 7 
Schizophrenic 
Female afl 
Employees 2i —.45 E a 
Neurotic 54 7 i 
Manic-depressive 3 


Schizophrenic 
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eight cells. Male neurotic patterns can now be 
clearly distinguished from those of manic-de- 
Pressives, schizophrenics, and organics. Female 
neurotics are distinguishable from female 
schizophrenics and organics. Twelve out of 20 
entries represent different patterns (rho’s be- 
low 40), 

The results from our fourth analysis with 
âge control are listed in Table 7. Age control 
has left most intercorrelations unchanged in 
comparison with those of Table 6. The most 
Striking change is the reduction of rho’s be- 


Table 7 
Correlation Coefficients (rho’s) of Subtest Ranks of 
Bellevue Raw Scores for Five Diagnostic 
Groups with Age Control 


s 
3 2 
2 E 
È 5 
is = 4 z 
5 8 g $ F 
2 El a 5 
iS) x B Q 
en ae 
Male 
Employees 29 =.11 -=.41 -.39 
eurotic 30 38 09 
anic-depressive -68 17 
chizophrenic 62 
Female 
Employees 21 =.24 =.24 -.05 
eurotic 51 36 28 


anic-depressive 82 


p ‘ -50 
Schizophrenic -76 


Table 8 
Correlation Coefficients (rho’s) of Subtest Ranks of 
Bellevue Raw Scores for Five Diagnostic 
Groups with Age and Sex Control 


s 
a 
+ 4 f 
s $ 3 $ 3 
p 3 £ 3 E 
[c] z a a ro 
Male 
Employees 11 45 -59 —.63 
eurotic -03 -31 =.43 
Manic-depressive .42 .08 
Schizophrenic .57 
Female 
Employees =07 -83 =.78 =.50 
eurotic -20 ʻ13 —.06 
anic-depressive -66 32 


Schizophrenic 48 


tween manic-depressives and organics in both 
male and female groups. The number of dis- 
tinct diagnostic ranks has been raised from 12 
to 1+ as a result of age control. 

The rank correlations from our independent 
sampling with age and sex control are re- 
corded in Table 8. Sex control has increased 
the number of distinct rank orders from 14 to 
16. Only four cells out of 20 have high posi- 
tive correlations. Two of these are of border- 
line significance. We can now distinguish well 
between all diagnostic groups except manic- 
depressives and schizophrenics, schizophrenics 
and organics in both sex groups. The high 
negative correlations between employees and 
all psychotic groups are noteworthy, 

We investigated the possible reasons for the 
consistently positive correlations between schiz- 
ophrenics and manic-depressives and between 
schizophrenics and organics. Two explana- 
tions seem plausible. We have found that a 
large number of incipient schizophrenics are 
diagnosed as manic-depressive. When we sepa- 
rated the younger groups of schizophrenics 
from the older patients of the same category 
and correlated the resultant two patterns with 
that of manic-depressives, we found that the 
correlation between old schizophrenics and 
manic-depressives became negative (—.24) and 
that the correlation between young schizo- 
phrenics and manic-depressives became more 
positive (.76). Psychiatrists consulted on this 
point agreed that the high relationship was not 
due to the similarity between young schizo- 
phrenics and manic-depressives but due to 
inaccurate diagnoses, A numbe 
diagnosed as manic or depressiy, 


Phrenics and organics 
schizophrenic p 
ing periods 


Scores Or quo- 
9 reveal that the 
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Table 9 7 Sai 
d Wide Range Reading 
7 ks of Wechsler-Bellevue Subtests an 
Ei Es raga Diagnostic Groups Obtained from Independent 
Seasons of 1,241 Records, with Age and Sex Controlled 
(N=40 in each group except for 34 female organics) 

; ie 
z i Manic-Depressive Schizophrenic Organi jë 
Male Female Male Pomale Male. Female Male Female Male Female 

Test : 

5 3 3 

1. Information 11 8 6 5 ; i : = z 5 
2. Comprehension 3 7 3 1 : : ; 
| Digit Span 8 10 imzo ú 12 4 i 4 ; P 

Suerte 7 9 no 2 2 5 so E 

5. Similarities 2 5 5 : : : 7 $ 

6 Vocabulary 12 11 1 4 2 2 z 4 a 

7. Picture Arrangement 9 1 8 7 . k . i 

8. Picture Completion 6 3 2 8 11 : : M 

9. Block Design 5 4 7 10 5 11 a ; 

10. Object Assembly 4 6 10 12 7 9 Ht k 0 2 

11. Digit Symbol 1 2 4 6 10 10 2 : 

12. WRAT Reading 10 12 9 9 3 1 2 


WRAT Reading test holds a low rank in non- 
psychotics and gradually rises to first rank with 
increasing disorganization or severity of the 
mental condition. A similar progression from 
low to high rank occurs in the information and 
vocabulary tests, though neither of them is as 
clear-cut as that of the reading test. The digit- 
symbol, block design, and similarities tests tend 
to decline in rank with increase in mental dis- 
turbance. The digit-symbol test is as definite 
in its decline as the reading test is in its ascent. 
The remaining six subtests do not show con- 
sistent rises or declines but vary with the diag- 
nostic group. 

The rank patterns of the two sexes within 
each group are positively correlated with each 
other. There are, however, some striking sex 


differences in each diagnostic group in at least 
one subtest. These differen 


quite consistent and may 


tic patterns derived fro 
universe. 


ces are, in our view, 
well disturb diagnos- 
m a sexually mixed 


In ord 
findings 
duce in 


er to enable psychologists to apply our 
to individual clinical cases, we repro- 
Tables 10 and 11 the means and 
standard deviations of the raw scores of each 
subtest for ten groups separated b 
sex. Only eight of the ten groups 
years up) were used in our analysis, but the 
data for boys ana girls between the ages of 
13 and 16 are added for the benefit of those 
who might wish to use them. The 
each diagnostic group are highly c 


y age and 
(from 17 


patterns of 
orrelated at 


different ages. Thus the rank orders of non 
rotics between the ages of 20 and 25 are sim! 
lar to the rank orders of neurotics betwee” 
the ages of 50 and 59. , 
The facts of Table 10 or 11 may be used k 
the following manner. 1. Administer oh 
Wechsler-Bellevue scale and the Jastak-BuOr 
Wide Range Reading test in full to get a ai 
score for each of the 12 subtests. 2. Subtract 
the mean of the subtest in Table 10 or 11 oe 
the obtained raw score on that subtest, “er 
careful to enter the column appropriate to od 
age and sex of the case. If the patient’s ™ 1 
score is larger than the mean, the differen 
will be positive. If the patient’s raw SCOP" oe 
smaller than the group mean, the differe if 
will be negative. 3. Divide the resultant jon 
ference for a subtest by the standard eee 
in Table 10 or 11 for that subtest. 4. Ra 
the 12 deviation ratios from largest positive 
smallest positive, or largest positive to larg a 
negative, or smallest negative to largest ae 
tive, as the case may require. 5. Correlate f 
patient’s rank pattern with each of the me 
patterns printed in Table 9, using the 1? 
corresponding to the sex of your client. i 


os 

Though our groups are small and lack “il 
validation, the largest positive coefficient iat? 
frequently place the patient in the APP Tacen 
diagnostic group. At times, all five coeta, the 
will be so close to zero that none wil! autio” 
reported patterns. The following ©!” A 


: 3 ation 
should be observed in the interpreta 
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Table 10 
Means and Standard Deviations of Subtest Raw Scores gn the Wechsler-Bellevue 
Scale and on the Jastak-Bijou Wide Range Reading Test $ 
for Patients of Ages 13 through 39 
Ages: 13=16 yrs. Ages 17-29 yrs. Ages 30-39 yrs. 

Male Female Female Male Female 

(X=110) (N=102) (N (N=165) (N=192) (N=138) 

Test Mean SD Mean SD Mean SD Mean SD Mean SD Mean SD 
1. Information SAO 4.21 6.97 13.06 4.89 10.58 4.52 13.04 5.28 10.83 5.09 
Z. Comprehension 7.56 2.91 7.08 9.99 3.58 $59 343 10.25 3.71 8.54 3.51 
3. Digit Span 9.32 1.88 9.17 10.15 2.47 10.12 2.11 10.03 2.21 9.83 2.26 
4. Arithmetic 4.87 2.31 4.16 6.84 2.95 5.45 2.46 7.02 2.76 5.33 2.48 
5. Similarities 7.06 3.33 7.35 9.$1 4.53 942 3.81 9.34 4.74 9.70 4.77 
6. Vocabulary 13.46 4.84 12.91 19.84 7.23 18.72 6.14 21.11 7.93 20.99 7.49 
7. Picture Arrangement 8.35 3.69 8.35 9.62 4.09 9.04 4.22 8.05 3.73 7.28 4.11 
8. Picture Completion 8.96 241 7.44 9:92: 235 8.29 3.02 1.60 2.89 7.97 3.16 
9. Block Design 17.24 7.02 14.10 19.84 8.57 17.07 8.38 17.43 7.42 15.04 8.31 
10. Object Assembly 16.74 3.86 15.17 17.17 440 16.09 4.52 15.70 4.78 15.72 4.74 
11. Digit Symbol 30.98 8.84 35.60 35.26 12.06 36.13 12.26 30.02 12.53 30.36 14.40 
12. WRAT Reading 52.37 20.89 56.91 74.39 23.04 75.80 19.10 76.58 23.34 76.48 26.46 


high correlation with the nonpsychotic order 
does not necessarily mean normalcy. Our rank 
Patterns do not take into consideration the de- 
gree of displacements between test scores 
which are very important in judging the dis- 
turbance of the individual. Electric shock and 
other treatments may radically change ability 
Patterns, The psychiatric diagnosis has a large 
margin of error, especially at the younger 
age levels. There are many other ability pat- 
terns which are not included in this study. 


Each major group, like the neurotic, appears 
to have two or more subpatterns which are di- 
agnostically important. The patterns we list 
may therefore be combinations of several sub- 
patterns. 


Summary and Conclusions 


We are now ready to answer the questions 
asked in the beginning of this paper. Our re- 
sults generally confirm the correctness of the 
assumption that ability patterns and psychiatric 


Table 11 
Means and Standard Deviations of Subtest Raw Scores on the Wechsler-Bellevue 
Scale and on the Jastak-Bijou Wide Range Reading Test 
for Patients of Ages 40 through 82 


Ages 40 - 51 yrs. 


Ages 52+ yrs. 


Male Female Male Female 
(N=171) (N=102) (N=114) (N=84) 
Test Mean SD Mean SD Mean SD Mean SD 
1. Information 12.32 5.26 10.42 5.03 11.04 5.07 
2. Comprehension 9.79 3.66 8.28 3.51 g 8.94 3.76 333 4.78 
3. Digit Span 9.80 2.19 9.68 2.34 9.35 Diop) sie 3.76 
4. Agithmetica 6.67 287 5.14 2.63 SAS 285 pie 2.28 
5. Similarities 8.35 4.76 8.70 4.42 6.52 4.27 EE 2.42 
6. Vocabulary 19.89 St 19.45 7.08 17.99 Big 7.43 4.14 
7. Picture Arrangement 6,42 3.67 5.74 3.51 a 744 19.65 7.13 
8. Picture Completion 9.06 3.02 7A7 2.67 7 i 3.32 4,2: 3.19 
9. Block Design 1487 7.19 1285 733 ek 3.28 6.75 269 
10. Object Assembly 15.09 4.78 13.67 sia 0.73 7.12 10.36 6. 
11. Digit Symbol 2515 11.91 2435 12.39 12:84 5.25 12.79 
12. WRAT Reading 71.02 25.20 77. ze 1314 945 9. as 
77.03 22.03 68.57 24.90 19.40 10.55 
7312 26.35 


410 a 
diagnoses are positively related. The = 
of measuring psychometric searing es 
adequate, though improvements wi sigs 
crystallize the value of such mee i 
stimulate research that is likely to objectify 
diagnosis. The psychiatric diagnosis as an ex- 
ternal criterion of comparison has a large mar- 
gin of error, but it can provide us with trends 
which are usable for normative purposes if 
cross validations are made to establish and ex- 
plain the size and nature of the error. Two 
variables which interfere with ability pattern- 
ing in diagnosis are age and sex. These vari- 
ables should be controlled whenever rank an- 
alysis of subtests is undertaken. The most 
serious obstacles to the derivation of diagnostic 
ability ranks are distortions inherent in the 
norms of the Bellevue scale. Constant errors 
seem to push up some subtest scores and pull 
down others, and thereby obscure differences 


due to mental characteristics of the group. The 
number and nature of such er 


guessed at. Changes in di 
standardization, changes in materials, in di- 
rections of administration and scoring, biased 
population samplings in regard to personality 
traits, clerical errors, and varying Proportions 
of sex and age samplings contributing to norms 
_ may be associated with the observed artifacts, 
With respect to Wechsler’s sign lists the 
following conclusions seem warranted: 


rors can only be 
ficulty levels since 
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1. The diagnostic signs hold up only when 
Taw score means are used for purposes of com- 
parison. Conversion of raw scores into 
weighted scores or quotients distorts subtest 
patterns. 

2. His sign lists fit our female patterns 
more closely than they do our male patterns 
for each of the comparable groups. 

3. Wechsler’s neurotic, schizophrenic, and 
organic patients are inadequately differentiated 
from each other either in the psychiatric diag- 
nosis or in the test results, or in both. 

4. It is important that the patterns pub- 
lished in this paper be checked carefully on sev- 
eral large and independent groups of each di- 


agnostic category to test both the reliability and 
validity of the ranks. 


Received March 2, 1953. » 
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Sex Differences and Other Aspects of Young 
Superior Adult Performance on 
the Wechsler-Bellevue 


Ralph D. Norman 


The University of New Mexico 


Interest in pathological performance on the 
Wechsler-Bellevue has been so great that, ex- 
cept for a few studies [2, 8], research with 
Normal superior adults has been neglected. Sex 
differences have also received little attention, 
except for the item analysis by Jastak [6] and 
a recent note by Strange and Palmer [11]. It 
Is the purpose of the present study to investi- 
Zate with young superior adults a number of 
Problems with clinical implications. These 
are sex differences as related to deterioration, 
verbal-performance differentials, clinical 

Signs,” and scatter, as well as item difficulty 
and the problem of ceiling. 


Subjects and Procedure 


The subjects were 85 males and 68 females, 
volunteers for testing, with no known pathol- 
ogy. All cases in the author’s files with a full 
Scale IQ of 120 or better were used. According 
to Wechsler [12], they may be categorized as 
Superior or very superior, constituting the top- 
Most 8.9% of the standardization population. 

ge, so important in W-B scatter [5], was con- 
trolled so that no subject was younger than 
or older than 29. Data on age were: 
males, range 18-29, mean 23.5; females, range 
15-29, mean 22.3. The majority were college 
Students, data on years of education being as 
follows: males, range 12-19, mean 14.4; fe- 
males, range 10-18, mean 13.9. All tests were 
Scored according to directions by Wechsler 
] or the supplementary manual by Kitzin- 
ger and Blumberg [7]. In order to test sex dif- 
ferences, it is important that full scale IQ’s be 
Teasonably equated. Table 1 presents data on 
distributions, showing that matching was 
Quite close. Full scale IQ statistics are: males, 
mean 127.5, SD 5.2; females, mean 126.8, 


SD 5.1. The ż of the difference of 0.7 IQ 
points is statistically insignificant, being 0.91. 


Table’ 1 
Distributions of IQ’s 

Males Females 
IQ Group N % N % 
120-124 28 32.9 27 Erg 
125-129 28 32.9 20 29.4 
130-134 18 21.2 15 22.1 
135-139 9 10.6 4 5.9 
140-144 2 24 2 2.9 
Total 85 100.0 68 100.0 

Results 


Sex differences and deterioration. Accord- 
ing to Table 2, there is a highly significant dif-_ 
ference between superior adult males and fe- 
males in Deterioration Quotient (DQ). The 
male mean DQ is 99.6, which is what is to be 
anticipated for their age group. The female 
DQ mean is 95.0, which is the DQ to be ex- 
pected for ages 35-39 [12]. Thus our young, 
very bright females have a DQ which Wechs- 
ler says applies to an age group some 15 years 
older. As a matter of fact, 17.6% of these fe- 
males have a DQ of 84 or less, which is what 
Wechsler gives as figure for ages 55-59, where- 


Table 2 
Quotients of Superior Adult Males and Females 
Quotients Males Females 
M o¢ M oD t 
Deterioration 93.6 10.7 95.0 10.7 4. 
. 5 . 6 2.61% 
Verbal 126.3 7.0 122.7 6.7 3.6 3.19% 
Performance 123.4 68 125.7 6.2 2:3 2.15% 
Full scale IQ's 127.5 5.2 1268 $1 07 0.91 


* Significant at the 5% level, 
** Significant at the 1% level, 


411 


412 


as anly 5.9% of males have a DQ ee a 
low. The ż of this difference of 11.79% is 2.18, 
significant at the 5% level. 


Sex differences and verbal-performance dif- 
ferential. Not only is there an “eo sex 
difference in DQ, but Table 2a so = 
veals that there are highly significant sex dif- 


f ce (using the r term) being 2.74, signifi- 
ce the 1% level. The female VQ is 3.0 


There are also racial 
(group) and cultural differences” [12, p. 
147]. It might be added that 


» according to 
» there are sex differences 


[11], reporting on un- 
verage, also find males 
» Whereas females are better 


Wechsler [12] also states that for subjects 
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with IQ's not far from average, a martain of 
8 to 10 points between V and P in either 4 
rection is within normal range. Using el! 
per limit as important, we find that 24.8 Fo 2 
males, but only 5.8% of females hk bet 
cess of 10 or more points of V over P. T E 
difference of 19.00% is highly significant, the 

being 3.44, significant at the 1% level. Among 
males, 10.666 have an excess of 10 or of 
points of P over V, whereas 22.19% of fema z 
show this excess; the 7 of the difference 0 


7, 
11.59% is 1.88, significant between 5 and 10% 
levels, 


Ie 
Sex differences and subtests. Since pas 
VOQ's, and PQ's differ significantly between 
sexes, do outstanding subtest differences a 
count for these results? Table 3 presents na 
for the 11 W-R subtests, demonstrating tha 
males are significantly superior in ag 
whereas females are significantly superior ! 
Digit Symbol, The vastly greater inferior 
of females in Arithmetic is what causes we 
lower DQ'’s, since Arithmetic is a “don’t hol in 
test; it also contributes to their inferiority + 
VQ. Their superiority in Digit Symbol, ples 
slight superiorities in al] other performan? 
tests results in a significantly higher PQ. Je 
tak [5] says that males tend to be LA 
Information, Picture Completion, Object eas 
sembly, Arithmetic, and Digit Span, wher it 
females tend to be better in Vocabulary, Die 
Symbol, Comprehension, Picture me e 
ment, and Block Design. According to h Jas- 
3, the Present data are in agreement wit 


Females t 
Subtest M o M o Diff. 
Information Mig 0.5 
Information 13.8 1.4 13.6 
Comprehension i 


1.7 0.1 


0.02 
13.8 2.0 0.0 1.27 , 
Digit Span 123 a 3.0 11.7 2.6 0.6 ae 
Arithmetic 14.2 2.5 11.8 2.8 2.4 0.12 
Similarities 14.9 1.8 14.9 1.5 0.0 1.30 
Vocabulary 13.6 1.5 13.9 14 0.3 1.22 
Pic. Arran. 12.9 2.5 13.4 2.6 0.5 1.63 
ic. Comp. 13.6 1.2 13.9 1.2 Qis 1.36 
Block Design 14.3 t3 14.7 1.7 0.4 0.33, 
Object Assem, i 13.2 1.8 13.3 1.7 0.1 2.20 
Digit Symbol 13.0 1.9 13.7 18 0.7 
bd Significant at the 5% level, 


t at the 1% level. 


Young Superior Adult Performance on the Wechsler +13 
Table + 
Significant Differences (t's) between Means of Subtests of Superior Adult Males 
Infor- Gj Digit r Pic, Pic. Block Object 
mation Compr. Span Arith, Simil. Vocab. Arran. Comp. Design Assem. 
Comprehension x - 
Digit Span 416°% 3.919 = 
Arithmetic x x - 
Similarities 5.279% 467%%  7.70»» 247° = 
Vocabulary x x 4.13°* x 
Pic Arran. 2.719% 2.6409 x 3:t9*e = 
ic. Comp. x x 3817» x 2.25% o 
Block Design 263%» 2.16" s.80%* x 4.35% 4.07%% - 
Object Assem, 2.76%% x 2.28° 2.75°° 6.35%% * x x 6.15** - 
Digit Symbol 2.913» 4,31%% x 3.14% 6.68%" 2,26" x 244" 5.3089 x 


tak in all cases except Picture Completion, Ob- 
Ject Assembly, and Comprehension. 

Sex difference and “hard signs” Wechsler 
[12] states that for total scores beyond the 
limits 80-1 10, one should divide the mean sub- 
test score by 4 to define a significant difference 
rom the mean. This was done, and again the 
Arithmetic test strongly differentiated between 
the sexes, The data for significant deviations 
are as follows: Positive—M, 8; F, 1; neither 
Positive nor negative—M, 69; F, 45; negative 
sae ", 22. The 7? of these differences is 

"significant at the 166 level. Females 
Povey have a larger number of negative, 
Nales of positive significant deviations, 


Mien differences and intertest scatter. Ex- 
amination of Table 


it row subtest menns nre greater than column me 


considerable variability within sexes in terms 
of subtest means. Since the assumption in clin- 
ical usage of the W-B is that in normal adults 
there should be comparatively little variation 
among subtest scores, it is important to note 
whether high intelligence and sex make ap- 
preciable differences in subtest means. Accord- 
ingly, significance tests were run (using the r 
terms), between subtest means for each sex 
separately. Table 4 yields results for superior 
adult males, and Table 5 for females. These 
tables are noteworthy for the very high num- 
ber (far beyond chance) of statistically signifi- 
cant differences which are obtained between 
certain subtests and others. 


Typical superior adult male scatter would 


. . . . . r, not 
3 indicates that there is only indicate V greater than P, as noted above, but 
Table 5 
Significant Differences (Ps) between Means of Subtests of Superior Adult Females 
Infor- Digit Pic. Pic. Block Object 
mation Compr. Span Arith. Simil. Vocab. Arran. Comp. Design Assem 
Comprehension x - 
‘Bit Span 5.33%" 5.1648 2 
Arithmetic 4.68%»  4,g3*# x - 
milarities 5.7548 356e 917» gops | 
ecabulary x x 6.32** 6.258% 5.1488 - 
ic Arran, x x 373 O BST Bors 7 m 
te. Comp, x x 6.67** S46** — 4.agee x x 
lock Design 3.96** 2.86%" 9-948 7.968% x 2.99% 3748 3 ong 
bject Assem. x x 3.99**+ 3.99%* 6 age 2.59%% i = -06 - 
igit Symbol x x óo 5.00% sge 7%? + SE doe _ 
Na? significant difference, x 3.50%% x 
w mbers in italies indicate that row subtest means 


ve Significant at the 5% level, 
5ignificant at the 1% level. 


are greater th: 


an column means. 
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also the following rang o big ot ahem 
wer than 8 other subte (z xcept Pi 

Si teen and mea peng Aegis 
significantly higher than all 10 o se si ; ~ 

ent significantly lower than 7 ot iers 
Yali S a Eoin Object Assembly, and Digit 
Symbol) ; Block Design significantly higher pete 
others (all except Arithmetic and Similarities) ; an: 
Digit Symbol significantly lower than 7 others (al 
except Digit Span, Picture Arrangement, and Ob- 
ject Assembly). These results are comparable with 
studies by Estes [2] and Merrill and Heathers [8] 
on other college males. Using deviations from Vo- 
cabulary, Estes found negative deviations in Digit 
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Span, Picture Arrangement, and Digit Samgo a 
tive deviation in Similarities, and zero hag = 
Block Design. With the same Scatter measure, Mer 
ril and Heathers found negative deviations in de 
Span and Digit Symbol, positive deviations in rig 3 
larities and Block Design, and practically zero 
viation in Picture Arrangement, i oe 
Typical superior adult female scatter T ae 
more pronounced, P js not only greater than bi ie 
the following are also shown (Table 5): a 
Span significantly lower than all other abian E 
cept Arithmetic; Arithmetic significantly a 3 
than all others except Digit Span; Similarities ol 
nificantly higher than all others except Block 


Table 6 


Significant Sex Differences in Items for Superior Adults 
i Agrees 
Test 


Item %o Success 
M F 


Information 15. Population 8 


with 
Jastak [6] 


VE GÒ AF gee M ves 
16. Wash. birth. 57.6 75.0 17.4 2.28% F Yes d 
18. Egypt 53 gas Iom age M Not: foun 
Arithmetic Problem 6 383 BES = 12.0 agaa M Not found 
Problem 8 894 75.0 14.4 2.29% M Yes 
Problem 9 M ae 
(0 sols.) at SiS ey apa 
(2 + sols.) 53.3 28.0 273 3.54%% 
(3 sols.) 20.0 8.8 11.2 1.99% 
Problem 10 M Yes 
(3 sols.) 24 588 204 3.77%% 
(2 + sols.) 50.6 28.0 a0 3.02* 
(3 sols.) 23.5 59 17.6 320% 
Similarities 10. Poem-Statue 
(2 sols.) o Pao is aig F Mes 
Vocabulary 23, Vesper ALO Bi ma sey F Yes 
28. Ballast 84.6 60.3 %43 3.298% M Fen 
30. Spangle ROO BS 283 ag F Yes 
Pic. Arran, 4. Flirt F Yes 
(3 sols.) 71.7 gg 16.6 2.6148 
(JANET) 36.5 544 ang 2.254 
(AJNET) 22.3 10.3 12.0 2.08% 
: d 
Pie Comp. 11. Trage 811 927 ang 2.18% F Not. four 
13. Thread 81.1 63.3 17.8 245% M Yer 
14, Brow Oe SS wy fae F men 
Block Design Item 2 
(6 sols.) 7A 19.1 12.0 2.47% F = 
Item 4 > s 
(4 + sols.) 74.1 91.2 174 2.88%% F xi 
Object Assem. Profile Not found 
(10 sols.) 14.1 38.3 24.2 3.450% F 2 
s Significant at the 50 level, 


ìgnificant at the 1% level, 


o 
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sign; and Block Design significantly higher than 
all others, except Similarities. Taking both sexes 
together, Similarities and Block Design are sig- 
pica high while Digit Span is significantly 
ow. 


Sex differences in item success. Jastak [6] 
Suggests that item analyses for sex differences 
be made by others either to confirm or to deny 
his results. Table 6 gives data on significant 
Superior adult sex differences in various scale 
items. Also indicated is whether results agree 
generally with Jastak.’ 


Again, there is strong male superiority in Arith- 
metic items, especially problems 9 and 10. For the 
scale as a whole, 10 items favor females, 8 favor 
males. This difference is not as overwhelming as 
that found by Jastak (32 favoring females, 18 
males), Generally though, where we have found 
Significant differences, we agree with him. We find 
Tesults he did not, in that more males than females 
Succeed with “Egypt” in Information and with 
Problem 6 in Arithmetic, while more females suc- 
ceed with “Image” in Picture Completion, and 
“Profile” in Object Assembly. An interesting dif- 
ference not mentioned by Jastak is that a signifi- 
cantly greater percentage of females give JANET 
Solutions to “Flirt” in Picture Arrangement, where- 
as a significantly greater percentage of males give 
AJNET solutions. Males are penalized here since 
the former solution carries 3 points of credit, the 
latter 2 points, 

A word might be said about the Digit Span test. 
Jastak [6] indicates that this test is loaded with fe- 
male superiority. He finds, e.g., that females are 
Significantly better in Forward 7, and in Backward 
4, 5, 6, and 7. We find no such differences, and if 
anything, slight but consistent superiority for males. 

Jastak states, too, that females are quicker in 
executing Block Designs. We find this to be true. 

e mean number of points earned by females is 
Breater in 5 of the 7 problems (all except problems 
3 and 6) and they are superior in the types of 
Solutions for problems 2 and 4, as given in Table 


Order of difficulty of items. Order of diffi- 
culty is, of course, not directly comparable be- 


1Our data are not directly comparable with Jas- 
tak’s for several reasons: (a) we have a much 
small.r Ņ (153 vs. 1,176); (b) we used only 120 
or better, whereas Jastak used a much wider 
range; (c) we made a number of statistical tests 
Not performed by Jastak, who defined success with 
an item as any success, whereas we tested for dif- 
ferences at different levels of success; (d) Jastak 
gives no indication of having matched his IQ’s as 
Carefully as we did. For example, 26% of his fe- 
males were nurses, who might be presumed to be of 
above average intelligence. 
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tween our superior adults and either Wechs- 
ler’s [12] or Jastak’s [6] group. However, in- 
terest attache$ to which items -cause particular 
dificulty in a highly intelligent group, since 
less intelligent groups would generally also ex- 
perience such difficulty. Over-all success was 
calculated by averaging male and female suc- 
cesses with each item. 

In the Information test, the following items are 
relatively harder for our superior subjects than 
their regular positions indicate: “Pints” (our rank 
order 13, regular rank order 5); “Height” (ours 16, 
regular 9); “Paris” (ours 17, regular 12); and 
“Pole” (ours 22, regular 17). The following are 
relatively easier: “Brazil” (ours 5.5, regular 11) ; 
“Hamlet” (ours 5.5, regular 14); “H. Finn” (ours 
12, regular 19); and “Vatican” (ours 15, regular 
20). The last 5 items in the test are apparently ap- 
proximately correctly placed. Jastak makes the 
“Pints” question number 4 in order, but we suspect 
it is more difficult than this. He leaves “Height” 
and “Hamlet” unchanged, moves “Paris” and 
“Pole” down and “Brazil” and “H. Finn” and 
“Vatican” up. The strong influence of schooling is 
shown in our group in that “H. Finn” and “Ham- 
let” are easier than “Pints” or “Height.” Our 
ranking correlates .855 with Jastak, .834 with 
Wechsler. 

In Comprehension, scoring 0, 1, or 2 credits, and 
taking mean points, we find “Shoes” misplaced for 
our superior adults, seemingly being difficult (our 
rank 10, regular 5). Intelligent subjects find it 
hard to give 3 reasons in order to earn 2 points on 
this item. If Wechsler persists in this type of scor- 
ing he should move the item farther down. Eglash 
[1] also mentions this problem with “Shoes,” The 
“Deaf” item is relatively easy for our group (our 
rank 5, regular 10), which may be accounted for by 
superior education, the “learning” criterion for 2 
points being quickly achieved. We do not entirely 
agree with Jastak when he says that Comprehen- 
sion has a dearth of items at upper levels of dif- 
ficulty. His method of scoring success (i.e, any suc- 
cess) indicates this; our adherence to point values 
does not since “Shoes,” “Laws,” and “Marriage” 
are closer to a mean of 1 than 2 points for our 
subjects. The p’s are .479 with Jastak, .645 with 
Wechsler. 

Using mean point values again, we find that in 
Similarities the “Air-Water” and “Wood-Alcohol” 
items are relatively harder for superior adults; 
Poem-Statue” is relatively easier, The former rank 
order 10 and 12 respectively as against regular 
Positions of 6 and-7; the latter ranks 6, 
10. Jastak moves “Wood-Alcohol” 
leaves the others unchanged. Our rank order co 
lates .727 with Jastak, 

In Arithmetic, 
achieved for the first 5 problems and for Problem 7 
by our group. Problem 6 is more difficult for f 


but 


e- 
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males, ‘and if both sexes are considered, ranks ae 

blem 7. We thus agree with Jastak on the 
ae difficulty of problem 7 over: Problem 6. 
T 9 and 10 are of about equivalent difi- 
culty for males, but not for females, the 10th being 
harder, The p’s are .936 with Jastak, .864 with 
Wechsler. 


On the Vocabulary test, the following are tila- 
tively harder for our group: “Fable (our rank 
order 20.5, regular 15); “Brim (ours S. reg- 
ular 16); “Armory” (ours 23, popular: 14); “Ves- 
per” (ours 29, regular 23); “Ballast” (ours 32, 
regular 28) ; “Dilatory” (ours 40, regular 36) ; and 
“Amanuensis” (ours 41, regular 37). The follow- 
ing are relatively easier: “Plural” (ours 8, regu- 
lar 18); “Nitroglycerine” (ours 8, regular 20) ; 
“Microscope” (ours 8, regular 22); “Hara-kiri” 
(ours 22, regular 34) ; “Aseptic” 
40). We are in almost complete agreement with 
Jastak who has moved all our “harder” words 
(except “Brim” and “Dilatory”) down, and all our 
“easier” words (except “Plural”) up. Certainly 
words like “Dilatory” and “Amanuensi 


Sis,” on which 
only 16.4% and 6.0% of our group are Successful, 
belong down at the v 


ery bottom of the list right 
before ‘ r -933 with Jastak, 


(ours 36, regular 


For Picture Arrangement, order of difficulty is 
as Wechsler has them. Practically 100% success is 
achieved on the first 3 items by our superior adults, 
Items 4, 5, and 6 are sufficiently difficult for them, 


since 80.0, 23.5, and 10.6%, respectively, achieve 
Perfect solutions, 


group, but 4 and 
“Stacks” is also 
for superior adults, Tanking 13 


as against regular rank 7. Items which are easier 


for our group are “Hand,” (ours 4, regular %3 
“Water” (ours 2, regular 10); and a oan ol 
(ours 8, regular 15). Jastak moves all pad acan 
items down, and all the easier (except “W zer 
which he leaves unchanged) up. The correlations 
are .785 with Jastak, .517 with Wechsler. ime 
In Block Design, the 4th item is especially ¢ h 
cult for our superior adults, but the 5th and 7t 
are easier. Rank order of the 7 items in our SA 
is 1, 3, 4, 6, 2, 7, 5. Jastak agree substantia i 
moving No. 4 down, No, 5 up, but leaving Lap 
unchanged. It would seem that some revamping ee 
time credits is needed in this test if the ie 
order is maintained, The p’s are .786 with Jastak, 
643 with Wechsler, . 7 
Over all, we find that Jastak [6] is S 
tially in agreement in his item manang E 
even though we base conclusions on a re 
selected group. Our p’s with Jastak are hig 2 
than our p's with Wechsler in ion er 
Similarities, Arithmetic, Vocabulary, gee 
Completion, and Block Design, and highe 
with Wechsler only in Comprehension. ai 
Ceiling of subtests. A unique aE = 
afforded when studying superior IQ’s to ah 
amine discriminative ceilings of subtests. Wi t 
153 subjects, we contrasted lowest and high 
quarters, or 1Q's of 120—123 and 131-1 #0 
respectively. The lower group N was 44 5 
include all 11 subjects of 123 10), a a 
orales (545%) and 20 females (43°59). st 
(ence roun N was 38 with 23 ma re 
(60.5%) and 15 females (39.590) ; they at 
definitely in Wechsler’s [12] very eee 
classification, The two groups thus have por 
parable sex Percentages. Table 7 presents CO 


Table 7 


Comparative Subtest Ceilings 


Lower ys, Higher Superior Adult 1Q’s 
IQ 120-123 IQ 131-144 
Subtest (N= 44) (N= 38) t 

wts as Muts x Diff. get 
Information 13.0 1.4 14.5 3.2 1.5 aor" 
Comprehension 13.0 1.6 14.6 1.8 1.5 oan 
Digit Span 10.6 22 13.8 2.2 3.2 324 
Arithmetic 12,1 24 14.8 2.5 2.7 5.530" 
Similarities 143 16 16.1 1.3 1.8 Clog 
Vocabulary 13.1 14 14.8 1.2 1.7 2.46" 
Pic. Arran. 12.5 2.4 13.9 2.7 at 3.1388 
Pic. Comp. 13.4 11 14.1 0.9 0.7 646%" 
Block Design 13.5 1.6 15.6 1.4 2.2 5.187% 
Object Assem, 12.5 1.8 14.3 1.2 1.8 3.19% 
Digit Symbol 12.6 1.8 13.9 1.8 1.3 
kx Significant at the 5% level 


“nificant at the 1% level. 


Young Superior Adult Performance on the Wechsler 


Parative subtest contrasting both 


groups. 


ceilings, 


Table 7, Block Design, with a f of 
6.46, is the best discriminating test. Wechsler holds 
it in high respect, saying that “it conforms to all 
Statistical criteria for a good test” [12, p. 97], and 
reporting that it correlates very well with the scale 
as a whole. Digit Span (¢ of 6444) ranks next in 
discriminatory Power, surprisingly, since Wechsler 
Says, “Memory for digits correlates with general 
intelligence up to a certain point, but beyond the 
ability to repeat 6 or 7 digits forward, its correla- 
tion becomes negligible” [12, p. 74] and also, “A 
good rote memory is of practical value but cor- 
relates very little with higher levels of intelligence” 
[12, p. 85]. We cannot agree with him since the 
test still is sharply discriminati g between superior 
and very superior intelligence. Vocabulary, Simi- 
larities, and Arithmetic (z's of 5.71, 5.53, and 5.24 
Tespectively) hold up as discriminators quite well, 
and we agree with Wechsler who holds them in 
high esteem. Object Assembly, like Digit Span, is 
Somewhat surprising (¢ of 5.18) since Wechsler 
feels that formboard-type tests “at the high levels 
ave very little discriminative value” [12, p. 97]. 
Two other tests Wechsler rates lowly as measures 
of general intelligence are Picture Completion and 
Picture Arrangement. He says that Picture Com- 
Pletion is relatively inadequate in discriminating 
between higher levels of intelligence (i.e, high 
average and superior). We find a comparatively 
low £ of 3.13 for this test, although it should be 
Mentioned that a low ceiling was built into it by 
Wechsler himself since no more than 15 points may 
© earned on it. Our lowest ¢ is for Picture Ar- 
Tangement (2.46), which Wechsler reports as cor- 
Telating Poorly with other tests and with the scale 
as a whole, Information, a test Wechsler respects, 
1s also comparatively low (¢ of 2.75), but it may 
not be as poor as it seems in view of the high de- 
Bree of education in both our contrasted groups. 


According to 


Generally, however, although z’s between a 
Superior and very superior group vary widely, 
all tests retain their discriminatory powers 
quite well, even those about which Wechsler 
Nas misgivings. 


Discussion 


Clinical implications of this study are sever- 
al. Sex differences are great enough to cause 
Significant discrepancies in DQ’s and verbal- 
Performance differentials, as well as in “hard 
signs.” The clinician examining the older, 
brighter female may not know how much de- 
terioration is a function of age or how much 
Of sex, since in our young, maximally function- 
ing females a loss equivalent to 15 years of 
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age is already apparent in DQ. The V-P dif- 
ferential, of {which Wechsler makes much as a 
clinically important sign, is ‘also affected by 
sex differences, as is the “hard sign” for Arith- 
metic. Also, typical scatter patterns exist for 
both superior females and males, independent 
of pathology. Other clinicians, such as Gar- 
field [+], Schofield [9], French and Hunt 
[3], and Schnadt [10], have already men- 
tioned the import of factors outside of pathol- 
ogy as instrumental in scatter. Even with our 
highly selected group, there is strong suspicion 
that item difficulty is not quite as Wechsler 
has given it, since all but one of our rank or- 
ders correlate higher with Jastak than with 
Wechsler. Jastak [6] feels that accuracy in 
item scaling is essential in order to derive clin- 
ically meaningful measures of intratest scatter- 
ing, as well as to provide for economy, ease, 
reasonable limits, and accuracy of testing. The 
matter of ceiling is important for determina- 
tion of discriminative values of tests between 
higher intellectual levels. As noted above, 
tests like Digit Span and Object Assembly are 
perhaps not as poor high level discriminators 
as Wechsler believes. 


Summary 


Using a group of young adults, all with 120 
IQ or better on the Wechsler-Bellevue, and 
with sexes matched in full scale IQ, it was 
found that: 


1. Significant differences exist between sexes 
in DQ, VQ, and PQ, and within sexes in VQ 
and PQ. Young, superior females appear to be 
more “deteriorated” than their age warrants. 
They are significantly inferior to males in 
Arithmetic, in which they also have signifi- 
cantly more low deviant “hard signs.” 


2. Other sex differences in items appear 
which affect the clinical utility of the test, and 
which generally corroborate Previous research, 

3. Highly significant scatter patterns exist 
which are functions of both sex and high 19 
level. oe 


4. Study of order of difficulty of items of 
subtests generally suppor+s Jastak’s [6] con- 
tention that there are important discrepancies 
In item gradation. i 


5. All subtests discriminate between Su- 
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perios CLO 120—123) and Very Superior (IQ 
131—144) groups, but not to the same degree. 
Received February 13, 1953. 
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Why Wechsler-Bellevue Full-Scale IQ’s Are More 
Variable Than Averages of Verbal and 


Performance IQ's 


Julian C. Stanley * 


University of Wisconsin 


Many clinicians have been puzzled by dis- 
crepancies similar to those in Table 1.* For per- 
Sons whose Verbal and Performance IQ’s on 
Form I of the Wechsler-Bellevue Intelligence 
Scale average 130, the Full-Scale IQ is greater 


Table 1 


Wechsler-Bellevue I Data [2] Showing That Full- 
Scale IQ’s Are Not Merely Averages of Verbal 


and Performance IQ’s 


“so 
: sse S 
Sa 3 gS $58 g 
&3 5 ES Sgp £ 
bites >g Ae 4A Eg 
10.0 120 140 130 133 
20-24 130 130 130 133 


45-49 70 70 70 67 
eee I a å P Q 


than 130, and for those whose 7 and P IQ’s 
average 70 the FS IQ is less than 70. That this 
result for IQ’s differing much from 100 is a 
mathematical necessity rather than an indict- 
ment of Wechsler’s tables has been sensed by 
most Psychologists, but so far as the writer 
nows no explanation has been published. 
he Phenomenon occurs with all kinds of 
aged measurements that are not perfectly 
intercorrelated. The teacher who gives several 
tests during a quarter and then averages the 
Marks each pupil has received notices that 
these final marks include fewer 4’s and F’s 
than he Customarily assigns to the separate 
tests. The More tests he administers, the great- 
*The writer is greatly indebted to Dr. Jerome P. 


hese and Mr. Robert F. Schweiker for ee 
clpful suggestions. 


ee, fo 1 d 
Schneix rT example, the comments of Sloan an 


der [1], 


aver; 


er will be this “shrinkage.” Also, the less reli- 
able and/or related his quizzes are the fewer 
high or low final averdges will his students 
obtain. Obviously, distributions of means are 
virtually always less variable than the single- 
score distributions from which they were ob- 
tained. Usually the teacher merely redistributes 
the average marks so that his customary per- 
centages of letter grades are given. This pro- 
cedure is quite proper in most instances, as the 
teacher is probably interested in only the rela- 
tive standings of the students within his own 
group. There are two cases, however, when the 
teacher should be aware of the effect of averag- 
ing: 

1. Average scores may be interpreted as belong- 
ing to a distribution of scores with a “standard” 
standard deviation. For example, IQ scores are 
used to identify a person’s performance with respect 
to the performance of others. We say that an indi- 
vidual who attains an IQ of 130 has obtained a 
score higher than that secured by approximately 97 
or 98 per cent of the people in the standardizing 
group. We so interpret the score because IQ’s are 
usually scaled to yield a standard deviation of 15- 
164%. If several IQ’s for the same individual are 
averaged, the mean score is not an IQ, since such 
means have a smaller standard deviation, depend- 
ing upon the number of scores averaged and the 
intercorrelations of the tests used. The error will 
not usually be serious if the intercorrelations are 
high. 

2. Average scores may be misinterpreted when 
not all the individuals to be ranked have the same 


a practically impossible task 
Here again, the 
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© 
seriousness of the error depends on the number 5E 
scores averaged and the intercorrelations of the 
tests. 


The implications of this restricted variability 
become obvious to anyone who plots on a pro- 
file several high or low local-norm standard 
scores and the standard score based upon their 
raw-score sum. If the testee did poorly on all 
tests, his summary standard score will be sub- 
stantially below the average of his separate 
standard scores—perhaps lower than any one 
of them. If he did well, his summary score 
will be higher than the average of the separate 
standard scores. The more tests involved, the 
greater these discrepancies are likely to be, 


Technical Note 


It can be shown that when each of N indi- 
viduals has z different test scores, 
of the distribution of 
equal to 1/nth of the 
ance of the z tests and 
of the Yan(n—1) 
among the z tests: 


1 


T 
e ne | 
is (1) 


This formula is the general basis for the 
various statements already made. If there are 
only two tests (2=2), oy? becomes Y, (0,2 + 
When dealing with the 
e Intelligence Scales, Forms 
the standard deviation of 


e formula yields a standard 
» Or 13.35, a “Shrink. 
3 ng the Full-Scale IQ 

1, we note that 100 + 


2. Wechsler, 


Julian C. Stanley 


7 
0.9(133 — 100) equals 130, the average of / 
and P IQ's shown there. ; : 

It can be proved that the correlation betw = 
Full-Scale IQ’s and the average of Verbal an 


(op + p) y 


, s , 
Performance TOS: pi 


LF Top 
2 


Vo,? + 0,2 F ayprep 
where v and p subscripts refer to Verbal and 
Performance weighted scores (not TQ's). a 
the particular age level under consideration. 
Probably €n will be somewhat smaller than soe 
since the intercorrelations of Performance tests 
are in general less than those of Verbal ge 
If o, and €n Were identical or if Trp Were Ae 
formula would equal 1, its maximum possi 
value. ae 

As n, the number of tests, approaches 19 
finity, oy? in Formula (1) Siri 
the average covariance, If, however, rijoidj 
Zero, oy? equals o?/n , and as n becomes “3 
the variance of the means rapidly gets smaller: 


approaches ri 


Summary he 
Some clinicians have wondered why t fa 
average of Wechsler-Bellevue Verbal and Sad 
formance IQ's differs in most instances oe 
the Full-Scale TQ, the former being 10 pr 
cent nearer 100, Average and FS 1Q’s do a 
correlate Perfectly, so nothing is gained by a 
ing such averages, which are not IQ's in the 
ual sense, 
Reduced vari 
common to al] 


» means 18 
ability of individuals’ me! 
kinds of measurements. 
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The Significance of Artistic Excellence in the 
Judgment of Adjustment Inferred from 


Human Figure Drawings” * 


John W. Whitmyre 


Veterans Administration Hospital, Salt Lake City, Utah 


Psychologists who utilize the human figure 
drawing as a projective instrument are often 
asked whether their inferences about the level 
of personal adjustment judged from the 
drawings are not basically inferences concern- 
ing the degree of artistic excellence which the 
drawings possess. A review of the literature 
has revealed no studies aimed directly at de- 
termining the answer to this question, and to 
find information concerning this problem is 
the Primary aim of this study. 


_ While many human figure drawing investiga- 
tions have dealt with the drawings detail by de- 
tail, Albee and Hamlin [1] have recognized that 
this 1S not the technique utilized by clinicians in 
their daily use or misuse of the human figure 
drawing. They state that the aim of their investiga- 
tion was to find whether “global or insightful im- 
Pressions by clinicians who are experienced with 
Projective methods have significant reliability and 
validity” (1, p. 390]. Their method was to permit 
experienced Psychologists to rank a series of human 
gure drawings according to the level of personal 
adjustment which the judges felt was reflected in 
each drawing as a totality, Thev found exceedingly 
Teliable interjudge judgments could be made, as 
well as rather valid ones, with the criterion of ad- 
Justment being arrived at from case history mater- 
lal. The investigation was expressly designed to 
avoid evaluating the drawings piecemeal. It is the 
belief that Projective test protocols are best ap- 
Proached from the configurational point of view 
which led to the plan of the present study. 


Statement of Hypotheses 


Tn order to evaluate the extent to which the 
artistic merit of human figure drawings is re- 


‘Submitted to the Graduate School of the Uni- 
versity of Pittsburgh in partial fulfillment of the 
requirements for the degree of Doctor of Philosophy. 

"From the Veterans Administration Regional Of- 
fice, Pittsburgh, Pa. 


lated to the inferences made about the personal 
adjustment of the artist, the following hypo- 
thesis was tested. 

Hy pothesis I. There is no significant rela- 
tionship between the degree of artistic excel- 
lence reflected in drawings of human figures 
and level of personal adjustment as judged by 
psychologists from human figure drawings. 

In order to learn whether psychologists are 
able to judge human figure drawings different- 
ly when evaluating them in terms of artistic 
merit rather than in terms of personal ad- 
justment, a second hypothesis was tested. 

Hypothesis IT. Clinical psychologists judge 
human figure drawings differently when eval- 
uating them in terms of level of personal ad- 
justment reflected therein, than when evaluat- 
ing them in terms of degree of artistic excel- 
lence. 

Since the value of any psychological test 
hinges ultimately upon its validity, the fol- 
lowing hypothesis was also tested. 

Hypothesis IIT. Actual level of personal ad- 
justment is more closely related to level of per- 
sonal adjustment as judged from drawings of 
human figures than to level of artistic excel- 
lence which the drawings are judged to Possess. 


Procedure 


Fifty drawings of a man and a woman, both 
on the same sheet of paper, were collected from 
Veterans Administration psychological files 
All psychiatric patients who had executed 
these drawings were between 22 and 33 years 
of age at the tie of testing and were white 
male, veterans of World War II who had 
achieved Wechsler-Bellevve IQ’s of at liese 
100. All had completed at least eight grades of 
schooling. No patients with known. teiitral 
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neous system damage were used. F; if i 
man figure drawings were then i apie ‘es 
veterans functioning adequately in daily i 
and without diagnosis or history of neuropsy: 
chiatric difficulties, but meeting the same re- 
quirements as the patient sample on the vari- 
ables of age, race, veteran status, and educa- 
tional achievement. In neither group were 
fragmentary drawings utilized. 


Two sets of drawings were then compiled, each 
set consisting of 25 psychiatric and 25 nonpsychi- 
atric cases. In each drawing group, the psychiatric 
and nonpsychiatric subjects whose drawings made 
up that drawing group were equated in terms of 
mean age and education. EE n 

After the obliteration of all identifying informa- 
tion, the above-described groups of drawings were 
presented to a group of eight advanced commercial 
art students for ranking according to the artistic 
merits of the drawings. The drawings were also 
presented to two six-man 
chologists holding Ph, D, 


merit, the other group ranke 
for adjustment reflected, and 
ings were thus evaluate 


adjustment” 
clinicians, In all Cases, 


of presentation was ob- 


e to procure artists’ art 
evaluations, psychologists’ art evaluations, and psy- 
chologists’ adjustment evaluations of all of the 
drawings in each group, 


Tn all cases, the rankin. 
signed to the drawings 
curve base-line deviates, 
to the procedure outlined 
to find the value 


gs which the judges as- 
were converted to normal- 
or scale values, according 
by Guilford [3]. In order 
S appropriate to the testing of the 


groups, the scale y; 
the subgroups determi 
values correlated, 
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scale values assigned the drawings by a 
subgroups. All these correlation te 
were then expanded by the Spennan Pora 
prophecy formula to correct for halving _ 
number of judges to compute the correlation. 


Table 1 
Reliability Coefficients and Standard Errors 
for All Judgments Corrected by the 
Spearman-Brown Formula 


Judges 


Drawing Judged j SE 

group for ; 
Artists I Art 943 va 
Artists Il Art = “ai 
Psychologists II I Art +936 “009 
Psychologists I II Art .969 aie 
Psychologists I I Adjustment .88+ ‘O18 
Psychologists II II Adjustment .937 


ae 
By the use of Fisher’s r-into-z transfor te 
tion described by Edwards [2], it was Porai 
to determine whether any of these relia ents 
values differ significantly, The oa et 
yielded by the psychologists when evalua are 
the drawings in terms of adjustment the 
slightly, yet significantly, less reliable eat 
other two judgments, psychologists’ judg™ if- 
for art and artists’ judgments for art. TOP ao: 
ference is significant at the .05 level © 
fidence. d by 
Hypothesis I. This hypothesis was boar ade 
the correlations between the psychologis® , 
justment scale values assigned the are 
and the artists’ art scale values assign” ajue 
drawings, For one set of drawings, the other 
was found to be .777 + .058 and for the ent 
set, .792 + -053. These significant, con” iz e 
and moderately high correlations india at 
jection of the hypothesis which Staren eË of 
significant relationship exists between of P% 
artistic excellence reflected in drawin E tenen! 
man figures and level of personal eae i 
inferred by Psychologists from these tistic e 
It is apparent that the degree of art ighlY 


cellence which a drawing possesses is en" 
related to the degree of personal a J 
which the drawing is judged to T e 
Hypothesis II. This hypothesis ajusto 
ated with the correlations between i gs one 
scale values assigned a set of drawin ae 


A eal 
group of psychologist judges and a ings 
values assigned the same set of 
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the other, equated group of psychologist 
judges. With one set of drawings, the value 
found was .885 + .039. The correlation for 
the other set of drawings was .859 + .037. 
These high, significant, and similar coefficients 
of correlation indicate rejection of the hypothe- 
sis which holds that psychologists judge human 
figure drawings differently when evaluating 
them in terms of level of personal adjustment 
than when evaluating them in terms of artistic 
excellence. Rather, they seem to have judged 
the drawings in much the same manner in each 
case. They apparently attended essentially to 
the artistic merits of the drawings. This 
Impression is supported by application of par- 
tial correlation procedures to determine the 
correlation between the art judges’ evaluations 
of the drawings for art and the psychologists’ 
evaluations of the drawings for adjustment 
with the effects of the psychologists’ art eval- 
uations “held constant,” or partialed out. In 
the case of each set of drawings, the high cor- 
relations between the psychologists’ evaluations 
of adjustment and the artists’ evaluations of 
art fell to insignificance when the psychologists’ 
art evaluations were partialed out. 

Hypothesis IIT. To test this hypothesis, the 
Pertinent values were the point-biserial corre- 
lations between the artists’ art judgments and 
the criterion of adjustment, and between the 
Psychologists’ adjustment judgments and the 
Same criterion. In one case, the correlation be- 
tween the artists’ scale values and the dichoto- 
Mous criterion psychiatric patient vs. nonpsy- 
chiatric subject was .095. The psychologists’ 
adjustment values in this case correlated .237 
with the criterion. Neither of these values is 
Significantly different from zero. In the case of 
the other set of drawings, the artists’ values 
Correlated .101 with the criterion, while the 
Psychologists’ adjustment values correlated 
-179 with the criterion. Again, these values are 
not significant. 

It was possible, utilizing the partial corre- 
lation method, to find values representative of 
the correlation between the psychologists’ ad- 
Justment values and the criterion dichotomy 
With the influence of the art values assigned to 
the group by the psychologists partialed 
cut. In the first instance, this procedure 
Tesulted in an increase in the correlation from 
-273 to 372, which is a value significant at the 
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-O1 level of confidence. In the second instance, 
the value of .169 was reduced to .002 when 
the influence of the psychologists’ art ratings 
was partialed out. Hypothesis III must, then, 
be rejected, for the correlations indicate that 
actual level of personal adjustment is no more 
closely related to level of adjustment as judged 
from drawings of human figures than to 
level of artistic excellence which the drawings 
are judged to possess. Also, the influence of the 
psychologists’ unconsciously judging according 
to artistic merit in one instance raised, and in 
the other instance lowered, the correlation be- 
tween their adjustment ratings of the drawings 
and the criterion of adjustment. 


e 


Discussion 


Perhaps the most clear-cut finding of this 
investigation is that there is a significant re- 
lationship between level of personal adjustment 
judged to be reflected in human figure draw- 
ings and the degree of artistic merit which they 
are judged to possess. Without regard to the 
validity or lack of validity of the human figure 
drawing as a clinical instrument, it appears 
that the psychologists who served in this in- 
vestigation ranked the drawings in such a way 
that their ratings corresponded to a marked 
extent with the art evaluations by the artists. 
Furthermore, the high correlations between the 
art and adjustment evaluations made by the 
two groups of equated psychologist judges in- 
dicate that, to a marked extent, they evaluate 
the drawings in much the same manner, 
whether they set out to rate art or adjustment. 

It must be remembered that in each case 
the psychologists who rendered the art values 
for a given group of drawings were not the 
same psychologists who rendered the adjust- 
ment values for those same drawings. Here 
the assumption that these two groups of psy- 
chologist judges are equal in ability to deal 
with the figure drawings is a most basic and 
necessary one. The similarity of the reliability 
and other comparable correlational values sug- 
gests that this assumption was a safe one. 

Furthermore, -it appears that neither art nor 
Itionahp to the cea a apereitble. ae 
a Š n of adjustment, pa- 
tient or nonpatient status. If one accepts this 
rough criterion of personal adjustment oie 
must account for the failure of the ratings of 
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these “average” clinical — ine 
inal Gane oe 
Observation reveals that m: ip 5 
5 1” veterans are fully as inadequa 
- steno in NP hospital files. Re is Ppa 
sistent with many of the findings of toe I , P- 
336], who has done extensive work nie vo 
projective tests with normals. She has ae 
that many disturbed projective test protoco s 
are yielded by apparently well-functioning in- 
dividuals. Her interpretation is that while the 
basic difficulties as projected on tests may be 
the same in the adjusted and maladjusted, the 
former group has faced and dealt with the diff- 


culties while the latter group has not [4, p. 
339]. 
If it 


t appears that 
level of adjust- 
re adequate and 


ent to assay 
ment is questionable. Either mo 


nces about fea- 


adjustment level from the 
drawings. 


Summary and Conclusions 


Human figure drawings were collected from 
psychiatric patients and “normal” veterans. 
Clinical psychologists ranked the drawings ac- 
cording to the level of personal adjustment 
which they felt was reflected in the drawings. 


John W. Whitmyre 


They also ranked the drawings A 
degree of artistic excellence. Caiimereia a 
tists also ranked the drawings for artistic m 
it. The results were as follows. 


I. Extremely reliable evaluations were 
achieved by all judging groups. . 

2. The clinical psychologists utilized aA 
tistic merits of the human figure drawings t 


; ; j RE tions 
a large extent in their adjustment evalua 
of them. 


3. The psychologists judged the aan 
in much the same manner, whether conscious!Y 
judging according to art or adjustment. Y 

4. Neither art nor adjustment ratings dy 
artists or psychologists show any o 
significant relationship with the diche 
psychiatric patient vs. nonpsychiatric subj eet 
The art values sometimes depress, sometin 
inflate, the relationship. , or 

5. As judged by the “average” clinical r 
chologist today, human figure drawings A 
ecuted by persons of average or co aaa 
intelligence seem to indicate art achieve™ ja- 
but do not seem to show any consistent Te 
tionship to level of Personal adjustment. 


Received February 23, 1953. 


References ion 
. tiga 
L Albee, G. W, & Hamlin, R. An her it 
of the reliability and validity of judgm 
ferred from drawings, J. clin, Psychol» 
5; 389-392, 


2 Edwards, A. 


r sy 
I. Experimental design a 5 o: 
chological research, New York: Rinehart, 
3. Guilford, J. P. Psychometric methods. 
York: McGraw-Hill, 1936. “ie 
4. Roe, Anne. The use of clinical diagnost ate 
niques in research with normals. In rae york: 
mert (Ed.), Feelings and emotions. 
McGraw-Hill, 1950. Pp, 336-342. 


be 


Journal of Consulting Psychology 
Vol. 17, No. 6, 1953 
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Protocol ` 
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Psychotherapists are generally agreed on the 
principle that the therapist is personally in- 
volved in the relationship as much as the pa- 
tient. According to Jung [4], both are mutu- 
ally influenced in the treatment. Sullivan 
[9] regards the therapist as a “participant ob- 
server.” In Rogers’ opinion, “. . . to treat an- 
other person as a person is to open oneself to 
change through the influence of the relation- 
ship” [7, p. 175]. From this conception of 
therapeutic interaction, Freud [3] and Obern- 
dorf [6] deduce that even competent thera- 
pists may occasionally be unsuccessful because 
of certain aspects of their physical appearances, 
their personalities, or their blind spots. 

Like the therapist, the administrator of the 
Rorschach test may also tend to elicit certain 
reactions from his subjects. In that event he 
should obtain protocols that are different from 
those given by subjects of examiners with dif- 
ferent characteristics. The present paper is con- 
cerned with this hypothesis of a significant 
over-all difference in protocols obtained by 
various examiners even when they are testing 
similar groups of subjects. This has already 
been demonstrated by Cleveland [2] and San- 
ders [8] for relatively inexperienced examin- 
ers who tested college sophomores under the 
highly controlled and presumably artificial 
conditions of an experiment. The purpose of 
the present study was to test this finding with 
experienced examiners who administered the 
tests under the standard conditions of the clinic 
to equated groups of psychiatric patients. 


Subjects 
Patients. Cases were selected from among 


1From VA Regional Office, Detroit, Michigan. 


the most recent patients tested by each of 12 
examiners at the Mental Hygiene Clinic of 
the Veterans Administration Regional Office, 
Detroit, Michigan. The assignment of cases 
to the clinical psychologists at the Detroit 
Clinic is determined by the days of the week 
when the patients are first admitted. Since 
there is no policy of scheduling any particular 
type of complaint on a given day, each psy- 
chologist had an equal chance of being assigned 
patients in all the diagnostic categories. A tabu- 
lation of cases of the different examiners re- 
vealed no significant differences in the propor- 
tions of various pathologies. The diagnoses of 
the final sample range from simple neurosis to 
prepsychotic condition. To facilitate the inter- 
pretation of results all subjects who were se- 
lected were male, white, between the ages of 
25 and 32, not disoriented, and their symp- 
toms were functional rather than organic. 
Psychologists, Three standards were used 
in the selection of examiners. The first was 
that they have a minimum of two years of ex- 
perience at the clinic. This helped to insure a 
common theoretical frame of reference and the 
use of similar techniques. They all admin- 
istered the Rorschach test according to Beck’s 
[1] instructions. Second, clinicians were se- 
lected only if they had tested at least 20 cases 
who met the criteria for the choice of subjects. 
Finally, an attempt was made to obtain diver- 
gent personalities on the basis of ratings of the 
psychological staff by two of the writers. 
There were nine males and three females. 


Method 


All records were first coded so that they con- 
tained no obvious clue to the identities of the 
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examiners or a pitie painea 
scored all the protocols y nethod 
i Iculation of reliabilities, a 
eG eet angle of records was also 
by a second person. 
g dake were analyzed in two ways. First, 
the raw or absolute scores of the detrtnitiants 
R, F, M, FC, CF, C, FY, YF. and J = 
sed in analyses of variance to determine w = 
ther examiners differed significantly from eac 
other in the values they produced in their pro- 
tocols. The F’s for each of these determinants 
are contained in Table 1. It was originally 
planned to include Y, but this scoring cate- 
gory was not used because of the paucity of 
responses in this categury. 


Second, in order to control for unequal 


analyses were 
ring categories 
ocols. Since all 
n are ratios of 
obviously be no 


contained in Table 1 


Results 


The interjudge reliabilities have a mean of 
and range between -66 and 1.00, Only 
three of the nine are below .90. The low cor- 
relation of .66 is attributable in part to the 


Table 1 


Differences in Rorschach Determinants 
of Examiners 


Scoring symbol Absolute score Percentage score 


F F 
aa ee eee 


1.39 
F 1.83* 2.00** 
M 1.30 .58 
FC 1.15 1.42 
CF -60 .06 
Cc 2.06* 2.37 
FY 2.568% 1.29 
YF -1.40 1.91* 
y 1.45 1.65 
* Significant at t e 


he 5 
** Significant ot the pir cent level or less, 


T cent level or less, 
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small number of YF responses, only 86 in 
4 cords. z 
TL 1 lists variances among examiners ‘ae 
absolute and percentage scores. Of the j 
absolute scores, variances among a er 
three, F, C, and FY, are significant at the p r 
cent level. This is approximately seven it 
the number of significant variances that ae 
occur by chance. Variances among eo a 
on three of the eight percentage scores, A 1 
and YP, are significant at the 5 per cent e 
This is approximately eight times the num i 
that would be expected by chance. The resu 7 
thus indicate that there are significant overe 
differences in the determinants obtained J 
various examiners from comparable group: 
subjects in an outpatient mental hygiene dne 
Some indications of the magnitudes of he 
ferences among examiners are afforded by B 
ranges of means of the significant eer 
nants. In the case of F, there is a gonsidere is 
range of means, from 10.0 to 20.8. If ige 
given its conventional interpretation as an hat 
dicator of control, the possibility arises t a 
when testing members of a homogeneous pa A 
ulation some examiners will elicit prey 
which indicate Overconstriction while the a 
cords obtained by others will indicate w 3 
control. In view of the range of means for ex 
1.0 to 3.4, it is also probable that gortan Jy 
aminers in this clinic tend to obtain nme 
dysphoric records while others with one ne 
able patients may seldom elicit such ae eee 
It is more difficult to assay the sign! att 
of the results for C and YF, the determi by 
with smaller ranges. Means of C obtaine and 
the different examiners vary between peri 0. 
-55; means of YF range between .05 Ea a 
e absolute magnitudes of these rant icant 
sufficiently small to suggest that the sign Je ° 
variances may be a function of the San nore 
patients, In the case of YF this is mace smal! 
probable by the previously mentione Thus 
number of responses in that a a ex 
espite the significant variances pare ge 
aminers for C and YF, confidence 1n of the 
sults must depend upon the repetition R 
study in the same clinic. ble, the meer, 
Assuming the results are stable, qin 
tudes of variances should be judge n som” 
of current standards of eT patho 
instances, Particularly those involvin! 


= 
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gnomonic signs, the presence of certain deter- 
minants even in small amounts may affect the 
Interpretation quite radically. This is particu- 
larly true of pure color, so that the narrow 
range of means for C may still point to a sig- 
nificant source of error. 


Discussion 


To what extent can these results be applied 
to the records obtained in different clinics? The 
answer to this question is determined in great 
part by theoretical orientation. In the opin- 
tons of the writers, the subject’s responses indi- 
cate how he organizes the drives aroused in 
the course of his interaction with a particular 
examiner in a specific situation. From this 
Premise it may be deduced that the administra- 
tion of the test by different examiners in the 
Same setting or the same examiner in different 
Settings might produce different protocols. 
This deduction creates considerable difficulties 
for the design of corroborative studies and the 
establishment of norms. However, it also sug- 
gests fruitful hypotheses. 

If this investigation were repeated in an- 
other Installation, even identical results could 
not be viewed as validating those of the pres- 
ent study unless conditions were identical. If 
the conditions were not identical, significant 
differences among examiners for more deter- 
minants might reflect more disturbed or less 
experienced examiners. A complete lack of sig- 
nificant variances might result from marked 
similarities in the interpersonal habits of the 
examiners, or from the fact that they were ex- 
Perienced. Similarly, the data obtained in con- 
nection with variations in setting or in type of 
Patient could not be compared with those of 
the present sample. 

Strictly speaking, then, the present results 
can apply only to a situation homogeneous 
With that of the present clinic. This principle 
Should also hold for the establishment of 
Norms. A partial recognition of this fact is af- 
forded by the frequently repeated statement 
that Rorschach norms can be used only within 
Wide limits. In part, clinicians claim, the ab- 
Solute magnitudes of the determinants take on 
different meanings depending upon the con- 
texts or gestalten in which they occur. More- 
Over, it is the hope of each examiner that, with 
Sufficient experience, he can learn to establish 


a group of subjective corrective factors that 
can cancel such sources of error as his idio- 
syncratic effect on the patient’s responses or 
unusual variations in the settings or patient’s 
motivation. Such a faith, however, is based on 
the assumption, one with which the writers 
are inclined to agree, that once the sources of 
error are eliminated, there are absolute norms 
which are comparable in different situations. 

Rather than stress lack of generality, then, 
it would be more fruitful to inquire into the 
conditions under which results can and cannot 
be generalized. Some light may be thrown on 
this problem by the basic dimensions that Mil- 
ler [5] attributes to the interpersonal relation- 
ship between examiner “and subject. The sub- 
ject’s character structure constitutes one group 
of variables. Within this group, the degree of 
pathology of the symptoms may bear upon 
the degree of variance among examiners. For 
example, experience has taught most clinicians 
that, with certain exceptions, the greater the 
pathology, the more inflexible are the responses 
of the patient. In other words, regardless of 
the examiner’s characteristics, the schizophrenic 
or compulsive may tend to order indiscrimi- 
nately their relationships with him by means of 
the same defenses with which they structure 
most of their experiences. Normal subjects, on 
the other hand, should be more sensitive to the 
examiner’s physical and psychological charac- 
teristics. Other things being equal, then, the 
number of significant variances among exam- 
iners should decrease with increasing pathol- 
ogy. This hypothesis should not be difficult to 
investigate. The Rorschach test might be ad- 
ministered by the same group of examiners in 
the same setting to three groups of patients, 
normal, neurotic, and psychotic. Normal pa- 
tients might be selected from medical clinics 
where there could be some insurance that their 
symptoms were not psychogenic. 


A second variable that may bear upon com. 


tive experience of 
» each 


; 1 experience 
used in the experiment with the Pits 


require fewer examiners than 


ables separately, of their interaction, and of 
; 
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combinations. The value of the latter is illus- 
trated by the prediction that there are more 
significant variances among inexperienced ex- 
aminers testing normal subjects than among 
very experienced clinicians with psychotic pa- 
tients. In the latter case, significant variances 
may tend to disappear, thus enabling the clin- 
icians to share norms. Comparable studies of 
additional dimensions of the interpersonal situ- 
ations should contribute significantly to the 
identification and ultimate measurement of 
the primary sources of error on the Rorschach 
test. 
Summary 
This study is concerned with differences in 
Rorschach protocols obtained by various ex- 
aminers from comparable groups of patients in 


a mental hygiene clinic. Factors controlled in 
the matching of groups were Sex, race, age, 
orientation, and organicity, 


Of nine absolute scor 


f the eight perc 
ent: 
scores, F, C, and YF, z a 
abilities of occurrence 


A theoretical frame of reference is proposed 


for the interpretation of results and the plan- 
ning of further research. 
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Personality Factors in Seizure States with Reference 
to the Rosenzweig Triadic Hypothesis 
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. Canter 
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There has been a great deal of controversy 
concerning the role of personality factors in 
the production and aggravation of epileptic 
Phenomena, Some investigators have tended to 

regard all seizures as expressions ot emotional 
conflict, whereas others have differentiated be- 
tween epilepsy as an organic, probably in- 
herited, illness and hysterical seizures in which 
psychopathology is the predominant feature. 
Many workers, of course, who have written 
on this subject make no definite distinctions be- 
tween organically based seizures and hysterical 


attacks. Instead, epilepsy and hysteria are seen 
as opposite poles of a continuum where organic 
or constitutional factors and psychological 


maladjustments operate together in an intricate 
fashion. 


The psychoanalytically oriented writers have 
most consistently emphasized the basic psycho- 
logical disorder which eventuates in epileptic 
symptomatology. While they do not deny that 
organic predispositions may exist, they regard 
the evidence from electroencephalography, 
drug treatment, and surgery as of little conse- 
quence for a real understanding of the attacks. 
Fenichel [4, pp. 265-267], Jelliffe [6], Mit- 
telmann [9], Clark [1]. and others have 
pointed to repressed hostility, extreme nar- 
cissism, and the regressive nature of the seizure 
as indicative of its basically psychological ori- 
gin. 


1The present paper is a condensation of part of a 
doctoral dissertation submitted to the Graduate 
Board of Washington University. The author wishes 
to express his gratitude to the sponsor of the disser- 
tation, Dr. Saul Rosenzweig, for his encouragement 
and assistance. The author also gratefully ack- 
nowledges the many helpful suggestions of Dr. 
Wilse Webb. The research could not have been ac- 
complished without the constant cooperation and in- 
terest of Col, Donald Peterson, MC, USA, and Dr. 
Earl Swartzlander of the Neuropsychiatric Service, 
Fitzsimons Army Hospital. 


Lennox [7] is one of the main protagonists of the 
point of view that epilepsy is essentially a neuro- 
logical disease and should be clearly differentiated 
from the psychogenic seizure episodes, which may 
he considered hysterical, Those who hold this view- 
point do wot disregard the tole of payehologieal 
stresses in the aggravation or even precipitation wt 
the convulsive syndrome, but they regard these 
as no more important than any other stress, 
physical or environmental, with which the organ- 
ically weakened organism cannot cope. Consequent- 
ly, they believe that epilepsy is principally a patho- 
physiological problem, and that in cases where no 
bran dysfunction is demonstrable, the term hys- 
teria may be applied. Both epileptic: and “psycho 

genic” seizures may occur, of course, in the same 

individual, and these cases will present special di- 

agnostic and treatment problems. However, in a re- 

cent restatement of his position, Lennox [8] has es- 
timated that 95% of epileptic patients in his ex- 
perience had no hysterical seizures, alone or in con- 
junction with the epileptic attacks. 

There is increasing evidence that any individual 
may have convulsive symptoms under the right 

conditions. Some investigators, ¢-2., Gastaut [5], 
have recently attempted to discover the relative 
“convulsive thresholds” of varying subjects such as 
idiopathic epileptics, schizophrenics, and hysterics. 
From this standpoint, the designation of “epilepsy” 
or “hysteria” becomes an arbitrary one, depending 
on the level at which it is concluded that the or- 
ganic weakness is a more deciding factor than the 
psychological stress which may be involved. Pre- 
sumably, an individual with a very low conyul- 
sive threshold would succumb to minor stresses, 
whether psychological or physiological, whereas an 
individual with a high threshold would bear up 
under all but quite severe stress. Nevertheless, the 
differential distinction between epileptic and psy- 
chogenic seizures continues to be used as a practical 
prerequisite for therapy. 


The present study is an attempt to outline 
certain personality patterns in two groups of 
seizure patients. A group of patients diagnosed 
as idiopathic epileptic will be compared with a 
group of patients whose seizures are attributed 
to emotional factors and who are considered 
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hysterical. It is expected that the patients with 
hysterical seizures will, as a group, show evi- 
dence of greater psychological disturbance than 
the group of epileptic patients. If this hypothe- 
sis is sustained, it will provide significant sup- 
port for the concept that the psychological in- 
volvement need not be as pronounced for pa- 
tients with an organic weakness. 

With respect to the personality variables on 
which the two groups might be expected to 
differ, the Rosenzweig triadic hypothesis was 
considered applicable. This hypothesis postu- 
lates that the availability of repression as a de- 
fense mechanism, the tendency to react to frus- 
tration in an impunitive 


With the hypothesis as a “guidepost,” 
postulated that a Psychogenic s 
ical) group would (a) repress to a greater ex- 
tent, (4) be hypnotizable to a greater extent 
and (c) react to frustration in an impunitive 


manner to a greater extent than a group of ep- 
ileptic patients? 


it was 
€izure (hyster- 


Selection of Subjects and Procedure 


Subjects for the study were obtained from 
the Neuropsychiatric 
rmy H: 


?The relationships betw 
triadic hypothesis, as the 
seizure groups, wi 


papér. a separate 
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troencephalographic data. An additional cri- 
terion for differential diagnosis was the ability 
of the subject to recall, under hypnosis, the 
events of the height of the seizure, for which 
there is, presumably, true amnesia in the gen- 
uinely epileptic patient. A detailed description 
of the procedure leading to this differential 
diagnosis has been given by Peterson, Sumner, 
and Jones [10]. 

In each case, the subject was seen first for 
hypnotic sessions by a military psychiatric resi- 
dent and then by the author for the psychologi- 
cal experimentation. Ncither the author nor 
the hypnotist, at the time of examination, 
knew anything of the results of any previous 
tests or examinations upon which the diagnosis 
might depend, nor the results of the other’s 
examination. The experimental variables, other 
than recall under hypnosis, did not enter into 
the final diagnosis. 


he two experimental groups for this study 
were as follows: 
: A Forty-four patients diagnosed as having 
idiopathic epilepsy. This group will be termed 
the epileptic group. . 

Forty-five Patients diagnosed as neurotic 
or character disorder, whose seizures are con- 
: s of Psychological maladjust- 
This Sroup will be termed the psycho- 


as they came 
ication at that time of what ay 
gnosis might be, it was impossible 
€ groups in advance on such vari” 
ables as intelligence, age, etc. However, the 
two groups as finally constituted do not dit- 
fer significantly in these respects. In eac 


to match th 


gen, the average TQ (Wechsler-Bellevu? 
> : = is approx! 
pi tale) 's 101, average age is app htly 


» and average education is ebe ö 
over 10 years, On military rank and lengt m- 
military service, the groups are also C° 


CE . 4 eri- 
The order of administration of the exP ol- 
mental measures for each subject was as 


: J i sen 
lows: hypnosis, reaction to frustration (Ro ie 
“weg P-F Study), repression measure, ai 
schach 


test, Thematic Apperception T 
selected cards), and Wechsler-Bellevue te 

hyp” 

Hypnosis Was measured by the number of afte! 

potic criteria met by the subject during, ani elude 

induction of the trance. These criteria Í 
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drowsiness, anesthesia catalepsies, amnesias, hal- 
lucinations, and regressive phenomena, these states 
in this order presumably indicating a progression 
from a relatively light to a relatively deeper hyp- 
nosis. There were 12 criteria in the list. The hyp- 
notist also made an over-all judgment as to whether 
a hypnotic state was induced, and, if so, whether it 
Was a medium trance or a deep, somnambulistic 
state, 

To obtain a measurement of reaction to frustra- 
tion, the Rosenzweig Picture-Frustration Study was 
employed, This is a limited projective technique 
consisting of a series of cartoon-like situations, each 
of which presents a common frustrating situation. 
The subject's written responses for each situation 
are scored as extrapunit (outward direction of 
aggression), intropunitive (inward direction of ag- 
gression), or impunitive (denial or dismissal of 
the frustration), in accordance with the scheme of 
Rosenzweig [14]. Norms for the test are available. 
Scoring was done in accordance with the criteria 
and samples provided in the manual. 

Repression was measured by means of the tech- 
nique employed by Rosenzw in previous studies 
[12, 15]. Sixteen jigsaw puzzles, with an object 
Pictured on each, were administered to the subject 
under the guise of an intelligence test. The sub- 
Ject was told that he expected to do well on 
all Puzzles, and that his score would be evaluated 
in terms of other individuals’ scores. Various de- 
vices to increase tension and promote involvement 
in the task were used, such as constant reference to 
the stop watch, frowning, and criticism of the sub- 
Ject’s performance. On eight of the puzzles the 
subject was permitted to finish, but on the other 
eight, he was forced to stop before finishing and 
was informed that the time limit was up. The sub- 
Ject was allowed to finish the first, second, fourth, 
sixth, ninth, tenth, twelfth, and fourteenth puzzles 
in the series, but was not allowed to complete the 
remainder. After the last puzzle, there was a 15- 
minute recess, and then the subject was asked to 
write down the names of all the puzzles that he 
could remember. It was assumed that, under the 


foregoing conditions, completed puzzles would be 
experienced as “successes” and incompleted puzzles 
as “failures.3 Repression was eonsidered as shown 
if the subject recalled more of his successes than 
his failures. 

The Rorschach test and 11 cards of the 1943 
edition of the Murray Thematic Apperception 
Test were administered to each subject. and the 
protocols analyzed for content and thematic indica- 
tion of anxious and/or hostile preoccupations. The 
TAT cards were, in order administered, 2, 14, 12M, 
6BM, 18M, 13MF, 5, 18GF, 12B, and 9BM. The 
Rorschach protocols were scored for content indi- 
cations of anxiety and hostility in the manner de- 
scribed by Elizur [3]. The TAT stories were 
scored in a similar manner by indicating whether 
the theme of each story suggested anxiety and/or 
hostility, or was “neutral” in content. It should be 
pointed out, in this connection, that the total anxi- 
ety-hostility score is considered by the author to 
be a more meaningful measure than either the 
anxiety score or hostility score separately, since 
each score contains elements of the other. The total 
score, on the other hand, probably is a relatively 
stable estimate of the intensity or generality of psy- 
chological tensions which may be expressed as 
anxiety on one occasion and hostility on another. 


All tests were scored without knowledge of 
the final diagnosis of the subject. The scoring 
on the Picture-Frustration, Rorschach, and 
TAT was independently checked by a psy- 
chology graduate student familiar with the 
scoring used. A check of a sample of approxi- 
mately one-third of the cases showed correla- 
tions with the author’s scoring of .94 to .97 
for the P-F variables, .95 for the Rorschach 
total score, and .90 for the total TAT score. 


Results and Discussion 


The psycholeptic group repressed to a sig- 
nificantly greater degree than the epileptic 


Table 1 
Comparison of Groups on Experimental Variables 

Epileptic Psycholeptic 

Experimental variables (N = 44) (N = 45) 
Mean SD Mean SD t 

Repression S-F score —0.068 1.876 1.622 1.911 4.15% 
Hypnosis No. criteria 6.14 4.67 4.87 4.18 1.33 
Impunitiveness 28.10 10.35 31.25 11.00 1.37 
Intropunitiveness 27.21 8.28 30.70 ` 9.43 1.31 
Extrapunitiveness 44.02 14.75 37.95 16.91 1.78* 
Rorschach Total A-H score 8.16 6.03 11.78 12.08 1.77* 
TAT Total A-H score 12.43 4.04 14.82 4.55 2.62%% 


* Significant at the .10 level. 
** Significant at the .05 level. 
*** Significant at the .01 level. 
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group. In the psycholeptic group, 33 subjects 
recalled a preponderance of successes, 4 sub- 
jects recalled a preponderance of failures, and 
8 recalled a preponderance of neither. In the 
epileptic group, 15 subjects recalled a prepon- 
derance of successes, 21 recalled more failures, 
and 8 recalled a preponderance of neither. 
Comparison of these frequencies results in a 
% value of 16.34, which is significant beyond 
the .01 level of confidence. 

In Table 1 the groups are compared on re- 
pression in terms of a score consisting of the 
number of successes recalled minus the number 
of failures recalled. In terms of amount of 
repression as well as mere number of cases of 
occurrence, the psycholeptics repress more 
than the epileptics. Both experimental groups 
were further compared with the results from a 
nonpatient group reported by Rosenzweig 
[12]. The mean success-minus-failure score of 
this group was 0.167 with a standard deviation 
of 1.683. There is no significant difference 
between the Nnonpatient, “normal” group and 
the epileptic group, whereas the Psycholeptic 
group represses more than the nonpatient 


group, the difference being significant t 
-01 level of confidence. moe 


mization of hypnotized versus nonhypnotized 
N d ’ 


hen an epileptic subj 
generally met all th 


hypnotizable psycholept 
criteria in an erratic fashi 
teria Supposedly indicat; 
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here) on the present subjects to suggest that 
the psycholeptics were, in general, more resis- 
tive to treatment and examination, possibly 
because of a realization that their seizures 
might be gainful to them and/or because of 
their greater difficulty in adjustment and es- 
tablishment of interpersonal relations. Of all 
the measures, hypnosis was probably the most 
susceptible to interference from situational 
factors, because of the preconceived attitudes 
toward it held by many of the subjects and be- 
cause many apparently feared this seemingly 
mysterious and unconventional procedure. 

In Table 1 is also presented a comparison of 
the two groups on the variables of impunitive- 
ness, intropunitiveness, and extrapunitiveness- 
In addition to comparing the groups with each 
other, each group's scores were compared with 
the Rosenzweig revised norms [13]. None of 
the epileptic mean scores differs significantly 
from the reported norms, However, the psy- 
choleptic group is less extrapunitive than the 
norm (mean: 45; Standard deviation: 13.3): 
This difference is significant at the .01 level 
of confidence. Likewise, the psycholeptic 
group is more impunitive than the norm 
(mean; 27; standard deviation: 9.45), this 
diference being significant at the .05 level of 
alee toe Psycholeptic group Oe i 

] More intropunitive than t 
rtre baa standard deviation: um 
ugh this rence does not reach a leve 

statistical significance, 
t was expected that the psycholeptic grouP 
would be more impunitive and less intro- °" 
is was not the case. In 
ency for the psycholept! 
itive and impunitive ae 
less extrapunitive than the epileptics. The ar 
one of extrapunitiveness 
Nonextrapunitiveness, or restraint 9 
outward aggression rather than restraint of 4 
aggression, This may be a significant finding 
n view of the interpretation of the psych? 
genic seizure as a turning inward of pent" 
hostility, i ere 
_ A factor to be considered here is the ambi" 
ity of the intropunitive response itse Sar- 
point previously noted by Rosenzweig and rive 
ason [15]. In many instances, the intropu”! 1 
response on the P-F Study seems to be an her 
aggerated impunitive type of reaction T4 
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than a reflection of real guilt feelings. Such 
answers as “I'm very sorry” have become so 
conventional and stereotyped that with many 
subjects they appear to mean only an easy way 
of getting out of the frustrating situation or 
glossing over the problem, in which actual self- 
aggression is probably absent. Thus, the intro- 
Punitive and impunitive responses may repre- 
sent the same nonagegressive trait. In this sense, 
the essence of the original postulation, restraint 
of hostility, appears to have been substantiated 
to some degree. 


A comparison of the groups with respect to 
Psychic tension, as indicated by the Rorschach 
and TAT anxiety-hostility scoring, is presented 
in Table 1. The comparisons are made in terms 
of the Total A-H score, which, as previously 
mentioned, is considered a more stable measure 
of the degree to which psychological tension 
1S expressed in the content and the degree to 
which neutral or pleasant concepts are aban- 
doned. 


There was no difference in mean number of 
Rorschach responses given by each group, but 
there was a definite tendency for the psycho- 
leptic group to give more responses with anx- 
lous-hostile content. Similarly, the psycholeptics 
told more anxious-hostile TAT stories and 
fewer neutral or pleasant stories. In general, 
then, “psychic tension” appears to be greater 
in the psycholeptic group. 


Table 2 


Correlation between Psycholepsy and 
Experimental Variables 


Experimental This f 
variables 
Repression S-F score -58 0 
Hypnosis No. criteria —.03 sh 
Extrapunitiveness -25 o 
Intropunitiveness 
‘ae! SS Be 10 
plus impunitiveness 
Rorschach Total 05 
A-H score 25 q 
TAT Total A-H score 35 = 


In Table 2 the results of the study are pre- 
sented as biserial correlations between a diag- 
nosis of psycholepsy and increasing scores on 
the different variables, with psycholepsy-epilep- 
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sy as the forced dichotomy. The single most 
discriminating variable is repression, a finding 
which suggests that this may be a more basic 
nality factor than the others in the dif- 
ferentiation of epileptic from psychogenic. The 
repressive aspect of the seizure is certainly the 
most immediate and outstanding feature, i.e., 
the “black-out,” amnesia, etc., whereas the 
factor of repressed hostility is a derived or in- 
ferred construct which becomes obvious only 
after considerable study and interpretation of 
various behavior patterns. 

In spite of the lack of difference between 
the epileptics and psycholeptics on the hypno- 
sis variable, the latter group presents a pattern 
of response consistent with what might be ex- 
pected of a hysterical group. The most definite 
difference is on repression, which has from the 
first been linked with hysterical disorders. The 
evidence for repressing or suppressing aggres- 
sion, as shown on the Picture-Frustration 
Study, is consistent with the interpretation of 
the psychogenic attack as a release or expres- 
sion of pent-up affects which the subject does 
not consciously recognize. The finding of 
greater “psychological tension” in the psycho- 
leptics, as shown by the Rorschach and TAT 
responses, is consistent with the Picture-Frus- 
tration results, if one assumes that the responses 
on the Rorschach and TAT reflect more un- 
conscious attitudes, whereas the P-F responses 
are closer to conscious realization of their 
meaning. The making of stories or the interpre- 
tation of inkblots is apt to be farther from the 
subject’s conscious control or censorship of his 
responses than his answers to the P-F situa- 
tions, which reflect to some degree a knowledge 
of, and willingness to abide by, social conven- 
tions. 

Although there were some possibly invalid- 
ating factors with respect to the hypnosis, 
there remains the possibility that hysterics are 
actually no better hypnosis subjects than other 
individuals, except perhaps under optimal con- 
ditions. The increased suggestibility of the 
hysteric, the importance of which is agreed 
upon by many workers, is only one of the fac- 
tors contributing to the hypnosis; other fac- 
tors are the motivation of the subject, his past 
and present attitudes toward hypnosis, and his 
relationship to the hypnotist. With the psy- 
choleptic group, the factors of secondary gain 
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which the seizures furnish, repressed aggres- 
sion toward the examiner, etc., appear to over- 
shadow any intrinsically greater degree of sug- 
gestibility. This finding is not unique, for 
various studies have failed to link hypnosis ex- 
clusively with hysteria, probably because of the 
complexity of the hypnotic phenomena as well 
as the dubiously hysterical populations upon 
which the hypnosis was attempted. 

The biserial correlations of Table 2, with 
psycholepsy-epilepsy as the forced dichotomy, 
are referable to the assumption that so-called 
psychogenic seizures and epileptic seizures are 
symptoms of a combination of factors which 
operate on a continuum from “almost pure” or- 
ganic “causation” to “almost pure” psycho- 
logical “causation.” The two groups do differ 
in terms of group averages, but the overlap 
in the psychological factors is considerable, In 
addition to the obvious imperfections of the 
- measuring instruments, it js also clear that 
there is no true dichotomy of Psychological in- 
volvement, but that the groups probably dif- 
fer because the subjects are drawn from dif- 
ferent points on the continuum. Gastaut’s 
findings, previously mentioned, ¢ 


f of convulsive suscepti- 
bility. The present study, in a gross fashion, 


approaches the problem from the Opposite as- 
pect in its suggestion of psychopathology par- 
alleling the degree of convulsive suscepti- 
bility; ordinary or normal Psychological ad- 
Justment goes with a low convulsive threshold 
EEG 
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tribute to increased susceptibility, if only 
through learning and not organic change. 


Summary and Conclusions 


Two groups of seizure patients were com- 
pared for evidence of psychological differences. 
In one group, termed epileptic, the seizures 
were diagnosed as symptoms of disturbed brain 
functioning. In the other group, termed psy- 
choleptic, the seizures were diagnosed as symp- 
toms of psychological maladjustment. ’ 

It was hypothesized that the psycholeptic 
group would (a) repress, (b) be hypnotizable, 
(c) react to frustration in an impunitive man- 
ner, and (d) show evidence of psychological 
tension, to a Sreater extent than the epileptic 
group. The hypothesis was sustained for (a) 
and (d). The psycholeptic group did not dif- 
fer from the epileptic group on impunitiveness 
as hypothesized, but was significantly less ex- 
trapunitive. This last finding was interpreted 
as indicating that instead of suppression of all 
aggression, only suppression of outwardly di- 
rected aggression is involved. No differences 
between the groups on degree of hypnotizabili- 
ty were demonstrated, i 

In general, the results indicate that certain 
Patterns of Psychologica] reaction are more prev- 
alent in seizure Patients in whom no evidence 
bi disturbed brain function can be found. The 
personality Pattern of the psycholeptic patients 
is consistent with the theoretical pattern for 
ysterics. There is also tentative evidence that 
the psycholeptic group deviates from the not 
mal with respect to the variables of repression 
and reaction to frustration, whereas the epileP- 
tic group does not appear to differ from thé 
normal in these respects, sprains 
I here is thus some support for the dijen 
entiation of seizure patients as organogenic A 
Psychogenic, but the considerable overlap he 
tween the 8Toups on the variables studied su 
Sests that the differentiation is not a dor 
one, and that it applies mainly to the ug 
ota Psychogenic-organogenic continuum. Ids 
Suggested that different convulsive thresho s 
may be positively related to different hich 
of the Pavchological maladjustment te the 


ta 
serves as the stress adequate to precip! 
Seizure, 
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Junior Personality Quiz 


Raymond B. Cattell and Halla Beloff 
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Alike in predicting school Progress and in 
child guidance work a need has Jong been felt 
for an adequate and comprehensive personality 
measuring instrument with which to supple- 
ment ability tests. Within the adult range, 
researches on the nature and measurement of 
whatever stable, independent dimensions of 
personality can be shown to exist [3] have re- 
sulted in practical instruments for the meas- 
urement of Personality source traits, 
the 16 Personality Factor Questionnaire (the 
16 P. F. test [11]). But it is only recently 
that the personality factor Structure of 10- to 
14-year-old children has become sufficiently 
clarified, in terms of behavior ratings [9], 
questionnaire responses [10], and objective 
tests [8], to permit any truly informed test 
construction, 

The present article deals with the deve 
ment of a children’s Personality 


paralleling the adult 76 Personality Factor 


such as 


lop- 


» Nowever, that in the present TPQ. as 


are no longer on the footing of introspective 
evidence but are treated as strictly behavioral 
responses, the meaning of which is to be found, 
not from the overt verbal meaning, but from 
correlations with observed behavior in real life 
situations. 

No description will be given here of the 
data which are being related to the question- 
naire responses, for they are set out elsewhere 
[8, 9], but a brief recapitulation will now be 
made of the research origin of the test, namely; 
of the factor analysis of the questionnaire re- 


Sponses upon which the Present test construc- 
tion rests, 


Synopsis of the Factor Analytic Foundation 
Since our intention was to arrive at a ques- 
tionnaire of nearer 100 than the usual 200 
items—on account of children’s limited me 
of attention—we Planned to begin with abou 
300 items, which could then be subjected : 
about two-thirds attrition by the selection Pi 
cess. These were chosen (a) to cover the who 
field of behavior, i.c., not merely neurotic, r 
areas; (4) to be of interest to children; (¢) t 
correspond in many cases to items in the adii 
+ being thus already known to TE 
particular factors. Hence, by apportion i 
about ten such equivalent questions to caa 
adult factor, we hoped to succeed in cro 
matching childhood and adult factors aes 
“marker Variables” alone. A 295-item T 
tionnaire was ultimately presented to 330 yer- 
and girls between the ages of 10 and 13 aa 
aging 11.2 years) using dual-choice ae y 
his set of items was reduced in num 
the following selection processes. n 
1. All items were dropped which children fou 


difficult to read, or of uncertain mermi, yes/no 
2. All items were dropped in which t 


I. 


The I, P. A. T. Junior Personality Quiz 437 


cut was more eccentric than 709¢-30%. 
3. All items were dropped which had no signifi- 
cant correlation with any other item. 


These eliminations left 103 questions, which 
Were factorized in a single matrix and rotated 
Successfully to simple structure with respect to 
14 factors. At this point, with the factors de- 
fined, 115 newly constructed items, which also 
Passed the first two of the above criteria, were 
Correlated on the same population in an “ex- 
tension of the matrix” by Dwyer's method 
[14], to provide more items for some factors 
which seemed likely to have less than 12 signif- 
icantly loaded items each. In this way about 
+ or 5 new items were picked up for each fac- 
tor, giving a total of 218 factored items. 

From this matrix of 218 items factored into 
15 factors we aimed to build up the required 
Junior Personality questionnaire instrument. 


Selection of Factors for Inclusion 


The decision as to which factors should be 
set up in the standardized test was made on 
the following considerations: 


1. Does the factor have large variance, i.e, is 
there a sufficiency of items having significant load- 
ing to make a minimum of a dozen good items for 
the factor measurement? In the end, three of the 
last five factors in order of variance were dropped 
for failure in this respect. 

.2. Does the factor have adequate split-half relia- 
bility? To assess the internal consistency of the fac- 
tors chosen by the simple structure the 218 items 
Were readministered to a fresh population of 76 
children. In this calculation of the split-half co- 
efficient for each factor the scoring was made only 
on items aboye a loading of 0.20 on the factor con- 
cerned—averaging about 14 items to the factor. 
These values ranged from practically zero to 0.83 
and the lowness of some suggested that further work 
1S required to improve the simple structure of the 
chosen factorization—a task best performed by in- 
dependent rotation of a completely new experimen- 
tal study. In the end the following factors were 
dropped (from the present questionnaire construc- 
tion) on this second basis (i.e., falling below a con- 
sistency r=0.41) : 10, 13, and 14. Factors 4, 6, and 
7, which also fell below the 0.41 limit, were, how- 
€ver, retained because they were highly satisfactory 
in regard to other criteria, and we suspected that 
sampling error in this relatively small group could 
have underestimated their true consistency. 

3. Could four psychologists independently exam- 
ining the items collected for each factor arrive at 
Common, verbally consistent psychological descrip- 
tions—and perhaps even interpretations—of the fac- 


tors discovered? This is not an attempt to put new 
wine in old bottles. As far as interpretation is con- 
cerned, if the factor unity does not fit pre-existing 
clinical or literary conceptions of psychological 
functional unities, such a finding is accepted prin- 
cipally as a reflection on the validity of the latter. 
But, at the descriptive level, on the other hand, 
one has increased confidence in the factor if the 
same, consistent central characteristic is assigned 
to it by different perusers of the collected loaded 
items. Factors 12 and 14 were the only ones in 
which differences of description and conception oc- 
curred, and this caused these, when combined with 


other defects, to be rejected. 
4. Is the simple structure convincing in terms of 


clearness of hyperplane, reaching a level of 60% 
or more items in the + 0.10 hyperplane? 


The combined appliéation of these criteria at 
a severe level would cut the questionnaire 
down to 5 or 6 factors. Among those lost 
would be some clearly recognizable, known 
factors in the adult realm, such as J (Sensitive 
emotionality), Q, (Will control), and H 
(Cyclothymia) as well as some less confidently 
labeled factors which are nevertheless of large 
variance in terms of accounting for child be- 
havior. It would seem a mistake to eliminate 
from a routine test, simply because split-half 
reliability is not yet high, any factor which 
could contribute (with refinement of items) to 
increasing educational prediction or clinical 
prognosis. For if and when these predictive 
powers are confirmed through use and external 
validation of the test, the reliability coefficients 
can readily be raised by increasing the number 
of items and by conventional item analysis, 
And since expense does not permit the publica- 
tion of two tests—one, for routine practice, 
containing only the 6 factors of highest clarity 
and reliability, and another, for further re- 
search, of lesser internal consistency but involy- 
ing all 15 newly adumbrated factors—it 
seemed best to compromise, by drawing the line 
at those 11 factors in which all the above cri- 
teria are tolerably satisfied simultaneously, 

Thus we decided to set up, in the standard 
questionnaire, factors 1, 2, 3, 4, 5, 6, 7.8, 9 
11, and 15, leaving the remaini Nese 
described elsewhere [10], 
basic research. 


ng 3, adequately 
to await further 


Questionnaire Design and the C 
of Factors F 
of convenience in use the fol- 


onsolidation 


With the aim 
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lowing considerations of design directed the 
choice and arrangement of items for the above 
eleven factors in the actual questioanaire. 
1. A uniform 12 items per factor was aimed 
at and proved to be feasible for all factors, 
since only on 1 or 2 items on two or three fac- 
tors did this force us slightly below the chosen 
lower limit of loading of 0.25. (The per item 
average is naturally. much higher.) Twelve is 
not a very large number of items on which to 
measure a factor, but it is as much as is com- 
patible with having a questionnaire which can 
be completed in a class period and within the 
endurance of a ten-year-old child, Higher relia- 
bility is best achieved, as we are planning, by 
constructing a second equivalent scale also with 
12 items per factor. Our first step was there- 
fore to examine the rotated matrix [10] and 
make tests of about the 24 highest-loaded items 
for each factor—counting on a 50% rejection 
rate by further considerations, 


2. We desired to avoid spurious correlations 


among the factor measurements and aimed to 
achieve this (a) b 


4) with a loading of 
) Item 203 (33 rigs 
—24 on 9, 
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the high factor scores. Where the item could 
not be inverted without damage to its meaning, 
it was left untouched and an “a” or “p” re- 
sponse in the same factor was inverted instead, 
thus balancing on position of responses. h 
Except for this latter concession, made in 
three factors, both position (first and second) 
and affirmative-negative responses were simul- 
taneously balanced in contributing to the factor 
score. Whenever inversion of the sentence or 
meaning had to take place, the opportunity was 
taken to employ the modification to make the 
Item agree better with the meaning of the fac- 
tor as it had finally come to be understood. 
Such changes were kept slight, and were car- 


ried out only by a person with long experience 
in this field. 


4. Inspection of the 
gested th 
cesses of 


132 surviving items sug- 
at in a few cases the secondary pro- 
(2) and (3) above might have re- 
sulted in taking items not altogether adequate 
in primary loadings, Moreover each factor stil 
Contained, on an average, two items of 15 


twelve with loadings initially between 0.25 an 
30, contrary 


limit of 0.30 in 
ingly it was decide 
to recruit fresh ‘ 


Inadequate and below 0.30, For this purpose 4 


i S set up, the items being 
specially created, on the basis of newly gaine 
Psychological insights through the factor anaty- 
SIS. 
These were administered to 120 eleven- and 
twelve-year-old boys and girls, along with th¢ 
questionnaire as jt then stood at 132 item 
and a second “extension matrix” was calcu- 
lated showing the correlations of the 11 facto" 
with each and all of these new items. Wh M 
ever a new item correlated 0.30 or more with # 
factor, without correlating significantly w 
any other factor, it was used to replace on? : 
the lowest 2 or 3 items in the existing factors 
a this way 28 improved items were introduc! 
replacing those deemed inadequate. op“ 
is final administration gave another or 
portunity to ensure that no modifie be 
Overlooked item could remain that wou hil- 
difficult of comprehension by ten-year-old “ons 
dren, and in two cases slight simplificat 
were found possible, 
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Table 1 
J. P. Q. and 16 P.F. Correlations 


— 
16 P. F. Test Factors 


J.P.Q. Factors A $ ¢ È F G 
1 
2 3 
3 -60 
4 -30 48* 
5 -23 
6 32 
7 32 
8 31 39 36 
9 
10 36° 
11 35* -33 


12 35° 


HT i M Ñ © © Oy Os @, 
51° -38 -30 
-H 32 68" -39 59 
51 38 38 62 -38 67 
44 
43 -53 49 
36 

63° 

33 -39 38 47 
34 


° i & 
Highest r’s in row and column. 


5. The factors were finally arranged with 
these items in cyclical order in the question- 
naire, for ease of scoring on the answer sheet, 
with a stencil. The items of easiest decision 
and reading were arranged at the beginning for 

warming up.” 

6. For uniformity with the adult 16 P.F., 
and because the inclusion of a brief measure of 
the intelligence factor along with other factors 
in the latter has already proved highly con- 
venient in many practical situations, it was 
decided to include a brief intelligence test here 
also, as a twelfth factor. For this purpose 12 
items were taken from Cattell’s earlier valida- 
tion and standardization of verbal intelligence 
tests [1, 2], being chosen to subtend the range 
from 10 to 15 years with maximum discrimina- 
tion. The total number of items in the test is 
thus raised to 144, which, at a maximum al- 


lowance of 1/4 minute per item, should still be 
within the usual length of a class period. A 
time-of-working distribution for various ages 
will eventually be worked out. 

7. Although the ultimate interpretations and 
labeling of these factors must await their cor- 
relations with all kinds of child behavior and 
performance, some preliminary indication of 
their nature could be gained by correlation 
with the adult 16 P.F. test factors, which al- 
ready have many associations. Accordingly the 
J.P.Q. was administered along with the 16 
P.F. to 100 16-year-old highschool boys and 
girls in the U.S.A. and 56 15-year-old second- 
ary school children in Britain. Only the r’s 
above 0.30 are recorded in Table 1. 

To approach a cross-identification of factors 
from the data yet available in Table 1 is not 
a simple step. For we have to take account first 


Table 2 
J. P. Q. Factor Intercorrelations 
1 2 3 4 5 6 7 8 9 10 11 12 

1 
2 35 
3 18 A4 
4 12 -10 -31 
5 —.18 18 39 37 
6 -.02 05 -.22 24 -.10 
7 -13 —.29 -18 -03 -19 25 ` 
8 17 01 —27 +29 —.38 17 04 
9 “25 AS 26 «2 31-09 -05 -42 ` 
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of the corrections for attenuation justified by 
the marked brevity of the factor measures ; 
second of the fact’ that any factor’ measure is 
at present still contaminated with others; and 
thirdly that even the pure factor measures 
themselves are slightly correlated. The com- 
bined effect of the second and third of these 
can be appraised from Table 2, representing 
the correlations among the 12 factors of the 
J-P.Q., as measured by the final test form 
upon a new population of 100 twelve-year- 
olds. 

The pattern of intercorrelations has a slight 
resemblance to the pure interfactor correlations 
obtainable from the matrix [10] but in the 
main the intercorrelatidns are larger and evi- 
dently due to some items in each factor stil] 
being appreciably loaded 
Further research will be directed to purifying 


tween 3 and 5—are conf 
having similar Profiles in 
with 16 P.F 


a match of JPO. Factor 1 wi 
Factor 7 and, similarly 2 ee el 


with H, 10 with F, 11 with Æ, an 
B. Thus in 9 of the 12 new factors 
alternate 16 PF, f 
pete with these interpretations 


Oho tpg 36, (V) 63, (VI) 36 
ith (39%) «54, 44, (XI) 56, (xin 
n eleven-year-old Population, i } 


Raymond B. Cattell and Halla Belof 


match + with a combination of C and Os 
(though its resemblance in meaning to both 
was actually noted, before correlation, in the 
former article [10]). C and Q; are alike in 
being labeled the neuroticism factors in the 
adult-population studies and in having some- 
what similar effects on social situations, C-B» 
in most potently reducing an individual's 
chances of being elected a leader [12]. 2 

The complexity of the manifest correlations 
in Table 1 beyond what would be expected 
from a simple one-to-one match, could arise 
from (a) the above brevity-attenuation effects; 
(b) the factor structure in preadolescent chil- 
dren being actually different from that Q 
adults; (c) the intercorrelations of the equiv- 
alent child and adult factors being differenti 
(d) the measures being contaminated in one oF 
both scales ; and (e) the two scales, adequate 
in their Proper age ranges, being distorted in 
the intermediate age where we try to make 
them meet, 

Only further experience and research can 
clarify these issues. As indicated, a study ÍS 9 
Progress to give an independent contribution t° 
the J.P.Q rotation, admittedly not perfect, 
and to replace contaminating items, whic 
should truly align the J.P.Q. and 16 P.F. 
factors now matched. On the other hand, wf 
respect to the difficulty in J.P.Q. Factor 
(with two marked r’s in its row in Table - 
it is Psychologically conceivable that two P# 
terns of adult n 


single “ = 


pence * ally, 
configuration of correlations is sound. ActU 


one of these two lowest is between inteligen 
In the J.P.Q. (Factor 12) and intelligen? of 
Factor B), each construct ity 
a dozen Standard test items! If test bre¥ of 
and application of both tests to the is 
f eir ranges, can do this to such a well-kne n 
tried test factor as general intelligence son” 
the r’s averaging 0.6 among the newer ee ch- 
ality factors are quite compatible with 4 ae 
1ng r of unity between the two factor me?” gth- 
of these Personality dimensions, with sai 
ened scales from the present tests. 


SS ae 
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Summary 


1. A multiple-factor, simple-structure factor 
analysis has been carried out (with extension 
devices) on 330 ten- to fourteen-year-old boys 
and girls on 423 groomed questionnaire items 
carefully chosen to represent the important di- 
Mensions of behavior in the total personality 
sphere, 

2. By dropping 291 items unsatisfactory for 
eccentricity of cut, ease of comprehension, or 
goodness of loading, as well as items for 4 
factors of defective variance or stability, a 
questionnaire of 144 items measuring 12 fac- 
tors by 12 items each has been constructed 
(adding 12 items for intelligence). By corre- 
lation with the adult 16 P.F. these factors are 
revealed to correspond with such well-known 
factors as general intelligence (B), general 
neuroticism (C and Q,), emotional sensitivity 

I), adventurous cyclothymia (H), anxiety 
level (O), will control (Q;), super-ego 
Strength (G), ete., though slight adjustments 
are still required for proof of full alignment. 

3. The usual test-presentation requirements 
of balancing “yes” and “no” answers within 
each factor, balancing suppressor loadings for 
Irrelevant factors, eliminating undue vocabu- 
lary and reading-time difficulties, arranging 
items in simple cyclical patterns for scoring 
Case, and presenting simple instructions and ex- 
amples for test and machine score-form use, 
have been worked out. The final J.P.Q. test 
(Junior Personality Quiz [121) has 144 
items; is suitable for children of 10-16 years; 
and permits completion in 30 minutes by 90% 
of children (but may require up to an hour for 
a small minority). 

The external or social validity of this inter- 
nally validated test remains to be investigated 
by use of the test in schools and clinics. How- 
ever, as Cronbach [13] and others have point- 
ed out in terms of information theory, the fact 
that the test deals with so many demonstrated- 


ly independent dimensions of behavior argues . 


for the whole giving better predictions than 
any single, long, and reliable scale, because 
each factor brings new information. Thus the 
use of only 12 items for the intelligence test 
and of the remaining 132 for eleven further 
dimensions should increase clinical and educa- 
tional predictions decidedly above that obtain- 


able from using this number of items (and the 
rest of the available testing time) in increas- 
ingly meticulous measurement of, say, intelli- 
gence alone, or in some personality test not 
demonstrated to deal with more than one or 
two factors. 

A temporary standardization has been issued 
with the test and a further age and sex stand- 
ardization on 2000 cases is in progress. Social 
extension of the meaning of the factors is also 
at hand in studies in press [6, 8, 11] relating 
the questionnaire factors to behavior rating and 
objective test factors obtained for the same 
population.? 


2The writers wish to express their thanks to the 
teachers and psychologists of Mooseheart and of 
the Decatur School System, for providing popula- 
tions for experimentation. 
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Manifest Anxiety Changes Concomitant 
with Client-Centered Therapy * 


James J. Gallagher 
Michigan State College 


: Any study dealing with anxiety must show 
Its recognition of the two-headed aspects of the 
concept and make clear which of the many pos- 
sible definitions is being considered in the 
study. May [7] has pointed out that anxiety 
can be considered either as a theoretical motiv- 
ating factor, present by inference rather than 
by direct observation, or as a descriptive term 
for a syndrome of physiological and psycho- 
logical tensions. It is primarily the latter that 
will be considered in the present study, and 
the term anxiety stress will be used to differ- 
entiate it from the term anxiety used as a con- 
Struct in motivation theory. 


Most of the newer texts, together with the 
Majority of recent literature in clinical psy- 
chology, have tended to emphasize the impor- 
tance f of dealing with dynamic personality 
qualities such as anxiety, guilt, ego-strength, 
etc., for personality predictive purposes. Corre- 
spondingly, less and less interest is being placed 
on standard diagnostic or nosological terms 
such as psychopath, manic, anxiety neurotic, 
etc. Projective techniques have been especially 
valuable in focusing attention on these dynamic 
qualities, yet few of these techniques have been 
developed to measure a quality such as anxiety 
stress directly. Most of the efforts of the pro- 
jectivists have been bent toward discovering 
the underlying qualities of the personality, and 
the anxiety discussed is almost always anxiety 
by inference. 


Wechsler and Hartogs [11] have developed and 
used short tests of motor skills, level-of-aspiration 
tasks, Draw-a-Person tests, etc. to differentiate be- 


1Data for this study were obtained by the Penn- 
sylyania State College research group, whose origin- 
al studies were published in Group Report of a Pro- 
gram of Research in Psychotherapy, Pennsylyania 
State Coll., Psychotherapy Research Group, 1953. 


tween anxiety neurotics, conversion hysterics, ob- 
sessive-compulsives, involutional depressives, and 
incipient schizophrenics, Although many of these 
measures show some real promise once the quanti- 
fication problem is solved, they are still in the ex- 
perimental stage. a 

Much more popular clinically is the use of tech- 
niques already designed for other purposes to 
measure anxiety stress. Rashkis and Welsh [8] de- 
veloped a means of detecting anxiety by use of the 
Wechsler-Bellevue scale; Elizur [1] has produced 
a content-scoring technique of scoring the Ror- 
schach for anxiety and hostility; and a recent study 
[3] seems to confirm the promise of such an adap- 
tation. 

Probably the most popular technique used to ob- 
tain a measure of anxiety stress is the MMPI. Tay- 
lor [9] constructed an anxiety scale by having 
judges choose from the MMPI those items they con- 
sidered as indicative of manifest anxiety, An item 
analysis of these items pared the number of items 
on the final scale to 50. Winne [13] constructed a 
neuroticism scale with items derived from the so- 
called neurotic triad which differentiated at the 1% 
level of confidence between 140 neurotics in a VA 
mental hygiene clinic and a matched group of 140 
normals, A recent study [5] measuring the rela- 
tionship between the Winne and Taylor scales 
found them to have a correlation approaching unity, 

Other attempts [4, 6] have been made to distin- 
guish the amount of anxiety in a patient by using 
combinations of the traditional MMPI scales in- 
stead of attempting to develop a new anxiety 
scale. Welsh [12] has approached the problem of 
profile analysis of anxiety with the most sophisti- 
cation and has developed two measures, an Anxiety 
Index and an Internalization Ratio, which seem 
to differentiate effectively between a wide 
of clinical and normal populations. 


; Problem. The Purpose of the present study 
is to determine if there have been changes in 


the anxiety-streis level as me 
asu 
PI scales, of j s Aoa 


variety 


tered therapy. 
It is rather dificult to get even tentative 
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agreement among various schools of thought 
on the goals of therapy; however, practically 
all disciplines mention the diminution of anxi- 
ety stress as an important subgoal. Certainly 
the removal of anxiety without a subsequent 
change in the ability of the individual to adapt 
is of limited value. It is equally true that with- 
out anxiety-stress reduction there is little real 
chance that a patient will be able to adapt 
himself more efficiently. It was felt by the 
writer that a constructive approach toward the 
merging of objectives of various schools of 
therapy would be obtained by measuring the 
effectiveness of each school in attaining the 
measurable subgoals that they claim to achieve 
by their methods. 


Hypotheses. 


1. College students undergoing client-cen- 
tered therapy will show significant decrease 
in anxiety stress following such therapy. 


2. There should be a relationship between 
reduction in anxiety and therapy success 
Therefore, a relatively high correlation would 
be expected between reduction in anxiety- 
stress scores and success in therapy. 


Method 


to diagnose these 
cept that persons 
Psychotic on the basi 


Were transferred to th 
e e staf iatri 
median number of therapy ; 2 ie = 


tween five and six, althou 
seen for 


apy ex- 


James J. Gallagher 


therapist and client that therapy contacts 
should end. 


The measures used in the present study 
were: 


1. The Taylor Anxiety Scale. This scale was not 
used in its entirety since many of the present sub- 
jects finished only 366 of the total MMPI items. 
This necessitated using only 34 out of the total of 
5C items. 

_ 2. The Winne Neuroticism Scale. This scale was 
included because of its high imputed relationship 
with the Taylor scale, and to find out if “neuroti- 


Roney, x : i 
cism” in this case was synonymous with anxiety 
stress. j 


3. The Welsh Anxiety Index. This scale was in 
reality a combination of the standard scales already 


in use on the MMPI. This score was obtained by 
the formula: 


Hs +D + Hy 
=— + (D+ Pt) — (Hs + Hy) 


Since this scale requires no scoring other ar 


the original scales of the MMPI, it could obviate 
the use of the Taylor and Winne scales if its pre 
dictive ability were the same or better than those 
scales, 

4. The Welsh Internalization Ratio. This W% 
obtained by the following formula: 


Hs + D + pi 
= 
Hy + Pd + Ma 
Fe This measure was included to see whether the I" 
tna ization Ratio would change in the ergi 
rection, toward externalization. As can be seen 


th i l 
the formula, the higher the score the greater ' 
internalization,2 


R= 


i d 
The standard ¢ test of significance was pati 


to determine the significance of the difference? 
meas” 
ding 
uct- 
for 


between the pretherapy and posttherapy 
ures. The differences on each of the prece 
scales were correlated by the Pearson prod 
moment r method with a multiple criterion 
success in psychotherapy to see which © s- 
measures predicted best to that criterion Si 
relations were also calculated between t the 
dividual Measures which went to make Y rar 
multiple criterion and pretherapy to Ta 
Py differences on the anxiety-stress scales. tiple 
The therapy criteria measures. Å gl oe 
Criterion for evaluating client-centered Priope? 


: Jop? 
therapy with college students was dev® de 
>y on 
The scores obtained by this population © in ® 
traditional scales of the MMPI were gY 


Previous article by the present writer 
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by Tucker [10] using the cases in the present 
group. ‘This multiple criterion consisted of four 
measures: 

1. A 29-item therapy rating scale scored by 

the therapist following the end of contact with 
the client. 
N 2. The same therapy rating scale scored by 
judges who read at least 6066 of the tran- 
scribed interviews, including the first and last 
Interviews, 

3. A I+item client rating scale which the 
client filled out at the time he took the post- 
therapy test battery. 

4. The P/N ratio, which was the ratio of 
negative to positive feelings in the final inter- 
view as compared to the ratio of negative to 
Positive feelings in the first interview. 


: These four criterion measures were com- 
bined into a total criterion score by weighting 
each measure according to the ratio of its 
summed intercorrelation with the other three 
measures. All the rating scales were constructed 
especially for this study by members of the 
group research project. For further informa- 
tion concerning the reliability of judges’ rat- 
ings, the construction of rating scales, etc., the 
reader is referred to Tucker's original work 


[10]. 


Table 1 


Differences between Pretherapy and Posttherapy 
Anxiety-Stress Scores 


Measure N Mean SD 
Taylor Anxiety 
Pretherapy 42 17.28 6.18 
Posttherapy 42 = 13.76* 6.13 
Winne Neuroticism 
Pretherapy 41 9.85 4.28 
Posttherapy 41 7.97" 3.82 
Welsh Anxiety Index 
Pretherapy 42 80.60 24.78 
Posttherapy 42 70.40* 24.60 
Welsh Internalization 
Ratio 
Pretherapy 42 105.76 15.86 
Posttherapy 42 98.41* 15.53 


*Difference between pretherapy and posttherapy scores 
significant at 1% level of confidence. 


Results 
1. Table 1 shows that all the scales used in 


the present study reveal a difference in the pre- 
dicted direction between pretherapy and post- 
therapy scores that is significant at the 1% 
level of confidence. Of particular interest is 
the change in the Welsh Internalization Ra- 
tio in which the group shows a definite trend 
towards externalization following client-cen- 
tered therapy. 

2. Table 2 reveals the correlations between 
anxiety-stress change scores and the therapy- 
success criterion measures. As might be ex- 
pected, the various anxiety-stress measures 
show a moderate to high agreement among 
themselves. It is clear that they are measuring 
somewhat the same quality, but they could 
hardly be used interchangeably on the basis of 
the present findings. Of particular interest is 
the high correlation between the Taylor scale 
and Winne scale confirming previous findings. 
One might think that this could be accounted 
for on the basis of considerable item overlap 
in the two scales. However, a check revealed 
that only six of the 34 items on the Taylor 
scale also appear on the Winne scale. 

3. The correlations between anxiety stress 
changes and the therapy-success measures 
show considerable variation. The Taylor scale 
seems to agree with these measures most ade- 
quately, although the Winne scale shows a sig- 
nificant agreement with every measure but the 
client rating scale. 

4. The Welsh Anxiety Index and Internali- 
zation Ratio did not fare so well, showing rela- 
tively low agreement with many of the criteria 
measures. One is forced to conclude from this 
that the scales designed specifically to measure 
neuroticism and anxiety stress are better pre- 
dictors of therapy success than are combina- 
tions of previously used MMPI scales. 


Discussion 


The results of the Present study seem to 
show rather clearly that there is a decrease in 
anxiety stress concomitant with client-centered 
therapy. As was stated Previously, this resul 
will have more meaning when placed b T 
other studies which show behavioral ch sie 
and Perceptual differentes as a resale of ies 
py. Also important would be the same ty oe 
comparison done by members oF an o ste = 
theoretical and therapeutic orientation "ERE 
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Table 2 
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Intercorrelations of Anxiety-Stress Changes 
ard Criteria for Therapy Success 


7 P/N 
i i Judges Client io 
Winne Welsh Welsh i Multiple Therapist ae Rati 
ici iety Internalization Criterion Rating Rating 
Measure Neuroticism Annie y Inte: nee 
5 49 
Taylor Anxiety +62 49 “38 ro rs pi A pi 
Winne Neuroticism -30 -58 54 R pc : pe 
Welsh Anxiety Index -71 -28 .08 3 ` 
oe Seman 40 13 33 16 37 


Note.—For .06 level of confidence, r=.355; for .01 level of confidence, r= 456. 


One may reasonably ask if the high correla- 
tions obtained between anxiety scales and 
therapy criterion measures were not due large- 
ly to the therapy measures depending upon ob- 
servation of this very stress reduction. On the 
client rating scale and the P/N ratio this 
might be of relatively high consequence; how- 
ever, on the therapist and judges’ rating scales 
the emphasis in judgments was Placed on de- 
velopment of insight, planning behavior, un- 
derstanding of self, etc. Thus we can say with 
some confidence that these correlations are a 
result of concomitant rather than similar be- 
havior. 


Summary 


therapy, 
client-centered therapy. 


measures, the Taylo 
Winne Neuroticism 


measures, 
Received March 30, 1953, 
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A Forced-Choice Form of the Taylor Anxiety 
Scale’ 


Charles E. Heineman 
State University of lowa? 


The Taylor Anxiety Scale [26, 27] is a self- 
rating scale which has shown rather consistent 
relationships with specific independently de- 
fined behavior variables [5, 6, 7, 9, 10, 14, Th 
18, 19, 20, 23, 24, 26, 28, 29, 30]. This scale 
(referred to hereafter as the 4 scale) prior to 
its most recent revision [27] consisted of 50 
MMPI items selected by judges as being in- 
dicative of manifest anxiety according to a de- 
finition taken from Cameron [3]. 

Even though scores on the 4 scale have been 
shown to possess considerable predictive value 
in a number of situations, it is possible that 
they may be influenced by various response sets 
that are not closely related to anxiety as orig- 
inally defined by Taylor. One such extraneous 
variable may be the desire of Ss to place them- 
selves in a socially favorable light. Thus Ss 
may consider not only whether a given state- 
ment is actually true of themselves, but also 
whether their answers will make them look 
well. 


Several findings suggest that A-scale scores may 
be influenced by the variable of social favorability. 
Among these are the positive skewness of the distri- 
bution of scores of the 4-scale standardization 
group consisting of 1,971 introductory psychology 
students who took the Æ scale between 1948 and 
1950, and the correlation of —-74 between the A 
scale and the K scale of the MMPI based on the 
Tesponses of 281 freshmen at the State University 
of Iowa. More direct support for the supposition 
that the expression of anxiety may be considered 


IModification of a dissertation submitted to the 
faculty of the Department of Psychology of the 
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socially undesirable has been found in an unpub- 
lished preliminary investigation. 

One method of dealing with the response tenden- 
cies associated with considerations of social favor- 
ability is to estimate their influence on test scores 
as is done in the K aml L scales of the MMPI 
[16]. Another method attempts to reduce the pos- 
sible effects of differences in the social acceptability 
of items on the test scores by use of the forced- 
choice technique [8, 22, 25, 31, 32]. On the basis 
of available evidence Cronbach [4] has concluded 
that the forced-choice technique can be made rela- 
tively free from the influence of extraneous re- 
sponse sets, offering the possibility of increasing the 
predictive value of tests in which it is used. The 
technique involves the “grouping of alternative 
choices to make them appear of equal value and 
have unequal significance” [1, p. 424]. In a forced- 
choice scale of anxiety Ss might be required to 
choose between self-descriptive statements presumed 
to be relevant to degree of anxiety and nonanxiety 
statements having equal value with respect to social 
favorability. The present investigation was con- 
cerned with the construction and evaluation of such 
a forced-choice scale of anxiety. 


Procedure 


Construction of the forced-choice anxiety 
scale. Two sets of anxiety items were used in 
the forced-choice scale. One set, hereafter re- 
ferred to as FC-1, contained the 50 items con- 
stituting the 4 scale. The other set of 50 items, 
hereafter referred to as FC-2, contained 
MMPI items not originally selected as anxiety 
indicators that showed a correlation of 41 or 
more with the total 4-scale score. The com- 
bined sets of 100 forced-choice items will be re- 
ferred to as FC-T. Items were defi 
anxiety statements if they were ra 
or only one of Taylor’s five judge 
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i i ved a 
tive of manifest anxiety and if they ypu 
correlation of .2+ or less with the tota 
score.* s 


; bility values for the 

iA order SO apai Aaye nonanxiety States 
en V d with them, the 566 items in the 
Ei ee the MMPI and 34 items in the Wes- 
pare fra of m [30], a total of 600 statements, 
ley Rigidity ve five-point scale of social favor- 
re os A students in introductory psychology. 
Aa s `y : instructed to assume that the answer to 
Ebens Ge Deme was “yes.” A rating of one repre- 
ral 3 d en of very favorable and five was 
4 cae. The mean favorability ratings of 
a ss items that were stated negatively 
me ORE. usually worry”) ranged from 1.38 
a while the mean favorability ratings of the 
7 paii items that we.z stated positively (eg, 
“I am inclined to worry”) ranged from 2.72 to 
4.62.5 Thus the denial of the anxiety was consis- 
tently rated as more desirable than its admission. 
Among the factors to be considered in constructing 
and administering a forced-choice scale is the 
number of choices in a block. Stewart [25] has re- 
ported that resistance is encountered when Ss are 
required to choose from among uniformly unfayor- 
able self-descriptive statements. She suggested that 
this resistance may be overcome if both desirable 
and undesirable alternatives are 
forced-choice block 
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: i 3.52 
B. I sometimes tease animals, ae 

C. Iam a high-strung person. 3 
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varied by means of a table of random numbers 


Statements were matched for hepe en 
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anxiety statement as most self-descriptive was 
scored 1, and marking it as least self-deserip- 
tive was scored 0. When the two nonanxicty 
Statements were marked and the anxiety state- 
ment was left unmarked, the anxiety statement 
was ranked between the two nonanxiety state- 
ments as being neither most nor least descrip- 
tive, so that the anxiety score was .5. When 
the anxiety statement was stated negatively, 
marking it as least self-descriptive was scored 
1, and marking it as most self-descriptive was 
Scored 0; leaving the anxiety statement un- 
marked was scored .5. By assigning scores of 
0, .5, and l, the possible range of scores was 
50 for both FC-1 and FC-2, so that the Key 1 
Scores covered the same range as the scores on 
the original 4 scale. 

In the second scoring method (Key 2) all 
items scored 0 by the first method remained 0, 
and those scored 1 remained 1. When a posi- 
tively worded anxiety item was left unmarked, 
a score of 1 was assigned if the matched non- 
anxiety statement was marked as least descrip- 
tive, and a 0 score was given if the matched 
Nonanxiety statement was marked as most de- 
scriptive. When a negatively worded anxiety 
item was left unmarked, an answer of least 
descriptive for the matched nonanxiety state- 
ment was scored 0, and a marking of most de- 
scriptive was scored 1. The possible range of 
Kev 2 scores was also 50 for both FC-1 and 
FC-2. Both scoring keys provided three anxiety 
scores, one for FC-1, another for FC-2, and a 
third for FC-T, the sum of FC-1 and FC-2. 

Subjects. The forced-choice scale was ad- 
ministered to 209 Ss in introductory psychol- 
ogy who had not made the favorability ratings. 
Each of these 209 Ss had taken the Iowa Bio- 
graphical Inventory, which included the A 
scale, about ten weeks prior to the adminis- 
tration of the forced-choice scale. 


Results and Discussion 


Relation between the forced-choice scale and 
the A scale. It was reasoned that if the corre- 
lations between the forced-choice form of the 
anxiety scale and the Æ scale did not differ 
significantly from the test-retest correlation ob- 
tained for the Æ scale, it might be concluded 
either that no extraneous source of variance 
due to the favorability factor is present in the 
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a scale, or that the forced-choice form has not 
led to its elimination. Table 1 presents the 
correlations ‘between the 4 scale and the Key 
I and Key 2 scores of FC-1, FC-2, and their 
total, FC-T. 


Table 1 
Correlations between the Taylor -7 Scale and Two 
Sets of Forced-Choice Items Treated Separately 
(FC-1 and FC-2) and in Combination 
(FC-T) on the Basis of Two Scoring 
Keys (N = 209) 


Correlated Scales Key 1 Key 2 
A, FC-1 EI -60 
A, FC-2 > 68 58 
a, FC-T 74 62 


The correlation between the Æ scale and 
the Key 1 score of FC-1, which consisted of 
the -scale items in forced-choice form, did 
not differ significantly from the previously re- 
ported [7] «l-scale test-retest correlation of 
83 (¢ = 1.79, df = 268). However, the cor- 
relation between the 4 scale and the Key 2 
score of FC-1 was significantly lower (p < 
.01) than the -scale test-retest correlation 
(t = 3.41, df = 268). Furthermore, the cor- 
relation between the 4 scale and the Key 2 
scoring of FC-1 was significantly lower (R = 
001, ¢ = 4.12, df = 206) than the correlation 
between the 4 scale and the Key 1 scoring of 
FC-1. 

In the light of other data to be presented it 
seems reasonable to interpret these results as 
indicating that the effects of social desirability 
may have been reduced or eliminated entirely 
as a source of variance common to the Æ scale 
and to the forced-choice scale only when Key 2 
was applied to the responses in the forced- 
choice scale. 

Relations between forced-choice subscales 
and scoring methods. It will be recalled that 
the anxiety items used in FC-2 were selected 
on the basis of their high correlation with the 
A scale when presented in single-choice form. 
A cross validation of these relationships could 
be obtained by correlating the FC-1 and FC-2 
scores in the present study. 


The correlation between FC-1 and FC-2 as 
scored by Key 1, was found to be 79 A correla. 
tion of practically equal magnitude (.74) was round 
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when these two sets of items were scored by Key 2. 
In addition, the correlations between each of these 
two sets of items in forced-choice form and the 
A scale, as shown in Table 1, did not differ signifi- 
cantly, either for Key 1 scores (¢ = 1.71, df = 206) 
or for Key 2 scores (t = .54, df = 206). 

These results may be taken as evidence that a 
set of items selected on the basis of high correla- 
tion with the A scale in the single-choice form 
were also correlated highly in the forced-choice form. 
Thus, scores on the forced-choice form appeared to 
be a function of factors similar to those influencing 
scores on the single-choice form of the test. Since 
both FC-1 and FC-2 could therefore be regarded as 
measures of manifest anxiety, these two sets of 50 
forced-choice blocks were combined into a single 
scale of 100 blocks (FC-T). 


Reliability. In order to evaluate the relia- 
bility of the forced-choice scales the internal 
consistency estimates of reliability were ob- 
tained by the use of the Kuder-Richardson for- 
mula 21 [13] and are reported in Table 2.8 


Table 2 


Reliability Coefficients of Three Sets of Forced- 
Choice Items Based on Two Scoring Keys 


(N = 209) 
Set of Items Key 1° Key 2+ 
FC-1 82 
a 69 
FC-2 80 -70 


FC-T 


89 83 
OTN eis ven ge 


* Kaitz modification, 
+ Kuder-Richardson formula No. 21, 


8In comparing the reliabili 
eliability of 
that of the forced-choice sate the = 
ing Categories for each item was consid 
e A scale and the forced-choj kac Bath 
by Key 2, allotted sc ae oe 


A » 5, and1. i 
cation of the Kuder-Ri jae ordin 


The 4 scale was significantly more reliable (2 < 
-001) than the Key 2 scores of FC-1 (¢ = 5.14) 
and of FC-2 (t = 5.08). The Key 1 forced-choice 
scale scores were more reliable (p = .001) than 
the Key 2 scores for FC-1 (£ = 7.31), for FC-2 
(t = 8.56), and for FC-T (t == 4.25). Thus the 
Key 2 scoring of the forced-choice scale yielded the 
least reliable measures. 

The lower reliability of Key 2 as contrasted to 
the 4 scale might be accounted for in terms of a 
reduction in social favorability as a factor common 
to the responses to the forced-choice form. The lower 
reliability of the Key 2 scores as compared to the 
Key 1 scores might be due to two factors: a de- 
creased influence of social favorability on the scores 
obtained by Key 2, and/or the reduction in h 
number of scoring categories from three in Key 
to two in Key 2, a reduction which would probably 
decrease the discrimination among subjects. 


Table 3 


Mean, Median, Standard Deviation, and Range of 
the 4 Scale and of FC-1, FC-2, and FC-T, 
Based on Two Scoring Keys 


(N = 209) 
Scale Mean Median SD panei 
A scale 13.68 13 7.66 Gi 
FC, Key 1 
0 
FC-1 22.02 22.5 6.32 oot 
FC-2 23.06 23.5 6.14 a et 
FO-T 45.08 45.5 11.67 1657 
FC, Key 2 
2 
oo 25.58 26 6.22 An 
FC-2 
26.91 27 6.30 12-78 


FC-T 52.49 54 11.82 


Distributions of scores. Table 3 shows a8 
means, medians, standard deviations, ‘the 
ranges of the scores for the 4 scale and for A- 
coree-cboine scale. The distribution i be ed 
Scale scores was shown to be positively ar 
by a test of normality given by MeN al 
[15], the deviation from normality being 35): 

cant at the .02 level of confidence (t 7 ormal 
The distribution of FC-T scores was ‘he 05 
for Key 1, and negatively skewed at Key A 
level of confidence (+ = 2.03) a scale 

ince the standard deviations of the of the 
and of the Key 1 and Key 2 scores the 
forced-choice scale were approximat ness 
same, the elimination of the positive ‘taker a 
characteristic of the A scale might be ba of the 
an indication of the decreased influene q-choice 
social favorability factor on the as 
scale scores. 
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Table + 
Correlation between the MMPI K Scale and Two 
Sets of Forced-Choice Items Treated Separately 
(FC-1 and FC-2) and in Combination 
(FC-T) on the Basis of Two 
Scorings Keys (N = 209) 


Correlated Scales Key 1 Key 2 
K, FC-1 =.55 -.36 
K, FC-2 -.57 41 
K, FC-T —.57 —.42 


Relations with the K scale. As the K scale 
of the MMPI was developed to serve as an 
estimate of the influence of social favorability 
On test scores, the magnitude of the relation- 
ship to the K scale of scores obtained on the 4 
scale and on the forced-choice scale might also 
be used as a measure of sensitivity to the social 
favorability variable. In Table 4 is shown the 
relationship of the K scale with the 4 scale and 
with the forced-choice scale. 


The negative correlations between the K scale and 
the Key 1 and Key 2 scores of FC-T were signifi- 
cantly lower (p < .001) than the correlation of 
—.74 between the Æ scale and the K scale (t = 
5.04 for Key 1, 7.85 for Key 2, df = 206).° Thus 
the use of the forced-choice scale scored by either 
key resulted in a marked reduction in the influence 
of the social acceptability as measured by the cor- 
relation of the test scores with the K scale. This 
evidence of a reduction in the influence of social 
favorability was also found when FC-1 and FC-2 
Were considered separately. 

The negative correlation between the Key 2 
Score of FC-T and the K scale was significantly 
lower (p < .001) than the correlation between the 
Key 1 score of FC-T and the K scale (t = 5-90, 
df = 206). Thus the Key 2 scores appeared to be 
Significantly less susceptible to the influence of social 
desirability than the Key 1 scores. 

The correlation between the Key 2 score of the 
forced-choice scale and the K scale still differed 
Significantly from 0 (p < .001), which may be ac- 
counted for, in part, by the overlap in the forced- 
choice scale and in the K scale of 11 statements that 
Contribute to the anxiety score when answered in 
one way and to the K-scale score when answered 
in the other, 


Bias experiment. The most direct method 


of tests that was administered join! 
forced-choice scale, It is not believ! 
interval affected the correlation 
scale and the K scale to any marked degree. 
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of evaluating the influence of a social desir- 
ability factor upon the various anxiety measures 
is to instruct Ss to answer deliberately in such 
a way as to appear in the most favorable light 
possible. A number of studies [2, 11, 21] have 
shown that scores on personality tests of the 
“yes-no” type are greatly influenced by such 
instructions. On the basis of the reasoning un- 
derlying the construction of the forced-choice 
scale, it would be predicted that it would not 
be so greatly influenced by biasing instructions. 

Sixty-four Ss from introductory psychology, 
who had not previously made favorability rat- 
ings or taken the forced-choice scale, were di- 
vided into two groups matched on the basis of 
their 4-scale scores. About two weeks fol- 
lowing the administration of the Æ scale 
one group of 32 Ss took the 4 scale under in- 
structions to appear in the most favorable 
light possible, and the other group of 32 Ss 
took the forced-choice scale under similar in- 
structions. In order to evaluate the influence 
of biasing instructions it was necessary to ex- 
press the raw scores in comparable units. Ac- 
cordingly the forced-choice scale scores and 4- 
scale scores were transformed linearly into a 
distribution having a mean of 20 and a stand- 
ard deviation of 4. The coded means, medians, 
and standard deviations obtained by the 
matched groups of 32 Ss under conventional 
and biasing instructions are shown in Table 5. 
The following discussion is based on the coded 
scores. 


The mean of the faked A-scale scores was sig- 
nificantly lower, at the .001 level, than the mean 
of the conventional A-scale scores (t = 6.31, df = 
31). The mean biased score of FC-T, Key 1, was 
also significantly lower, at the .01 level, than the 
mean conventional A-scale score (t= 2.80, df= 
31). On the other hand, the mean biased score of 
FC-T, Key 2, did not differ significantly either 
from the mean of the conventional 4-scale scores 
(= 1.78, df = 31) or from the pean conventional 
Key 2 forced-choice score of 20,00 of the standard 
sample of 209 Ss. These results demonstrate that 
the Æ scale and the Key 1 scoring of the forced- 
choice scale are subject to the influence of the social 
favorability variable, while the Key 2 scores ap ea 
to be relatively insensitive to defensive kiude, ; 
$ Furthermore, the mean biased 4-scale score wa 
significantly lower (p < -01) than the mean biased 
score of FC-T, Key 1 (i = 3.60, df = 31). I 
turn, the mean bias score of FC-T, Key 1 2x4 
nipi lower (p < .001) than che mean bias 
a ia riiai 

core of FC-T, Key 2 (¢ = 5.53, df = 31). It is 
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Table 5 


d ean iati f Conventional and 
Medi Deviations of Conv entiona 
Transform dians, and Standard I a Seb auld 
i A 2 he le ane and df Biased Forced-Choice Scale Scores (FC-T) 
Biased A-Sca Sy 


Scored by Two Keys for Two Groups of 32 Matched $s 


-scale group 


le group 


FC-T, Key 2 


scale A-scale -l-scale FC-T, Key 1 bias 

— bias cony. bias = 

conv. k — 20.26 

19.13 15.03 19.03 ae 20.02 

Mean ie i350 17.82 pa 2.57 

Median 7 2.49 3.74 1,92 ae 
SD = 


apparent that the forced-choice Aile ee 
ither key, was less sensitive to deli erate ng 
a. 1 scale. Nevertheless, forced-choice scale 
cer oe more susceptible to faking when the 
senna brent statement was considered in the 
Key 1 scoring. 

Additional considerations. The instructions 
used in the bias experiment were equivalent to 
instructions to rate items for favorability. 
Scoring by Key 2, under biasing instructions, 
provided a means of estimating whether state. 
ments of equal social favorability when rated 
singly were rated as equally desirable after 
they were grouped into forced-choice blocks. If 
the matched anxiety and nonanxiety statements 
were regarded as equally favorable, one might 
expect that each of the two statements would 


more favorable, so that 
mean of the faked Key 


» Not coded, 


ed from a hypothetical 
can of 50 between the .02 and 05 


confidence (¢ = 2.36, df = 3T): 
anxiety statements we 
more frequently as being desirable th 
matched nonanxiety Statements. This 


vidual favorability 
actly equal favorability wh 
statements were put into forced-cho; 


The effectiveness of a forced-chc; 
ety in reducing or eliminating si 
as a variable affecting test Scores may also 
ited if anxious and nhonanxious individy 
fer in their estimate of the soci 
anxiety Statements, 


ice scale of anxi- 
ocial favorability 
be lim- 
als dif- 
al favorability of 


In order to test this Possibility 


selected 
2+ anxious and 19 nonanxious Ss ee ae 
from the 108 Ss who had rated the MMI I Eion 
Wesley Rigidity Scale items for social Pron the A 
Individuals who scored in the upper 20% nN who 
scale were defined as anxious, and are non- 
scored in the lower 209% were wg = two 
anxious. The favorability ratings of nl the 
groups of Ss were compared with ied their 
50 anxiety items from the 4 scale aewitively 
matched nonanxiety statements, The 37 Peeters 
Stated anxiety items in FC-1 were eee? 
Separately from the 13 Negatively stated vorabilitY 
The difference scores between the a were 
ratings of the anxious and nonanxious: iad anxi- 
computed for each of the 37 positively sta nanxiety 
ety items and for each of their matched aes state- 
items, The anxious Ss rated these 37 4 0 
ments as significantly more favorable, aia df= 
level, than did the nonanxious Ss Ct Se 13 nega- 
LEATA Applying the same procedure to the matche! 
tively stated anxiety items and to their hug. i 
nonanxiety items, jt was found that i favor- 
rated the anxiety items as significantly bais ae 
able (p < .001) than did the nen anxious 
5.97, df = 24). These results indicate ame 
S regard the expression of anxiety less unta 
than do nonanxious Ss, 


bly 


xious 

Since anxious Ss differed from nemanxietd 
Ss in their favorability ratings 0 ability 
statements, the influence of social an oh 
Was probably not entirely rg resenta- 
fest scores regardless of the form o aoe 
tion and of the scoring method. hale 
Tesults of this investigation indicate st scores 
influence of social desirability on ie the us 
could at least be drastically reduced by 
of the forced-choice method. 


jtem 
, rded jte! 
“Favorable ratings of a negatively Tatings ave 
had the same meaning as unfavorab when 9S Faly 
Positively worded item. For Inseance; a negat 5 
a relatively favorable rating A worry», 
worded item, such as “I don’t usually 


esi 
. as und 

A : iarreins as 
considered the behavior of worrying 
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Summary 


The present study was concerned with the 
development of a forced-choice form of the 
Taylor Anxiety Scale designed to reduce the 
eflects of possible tendencies by Ss to consider 
the social desirability of particular responses. 
The forced-choice form consisted of three 
Statements, an anxiety statement and a non- 
anxiety statement of comparable social favor- 
ability, and a second nonanxiety statement 
differing in social favorability from the two 
matched statements. Favorability ratings were 
obtained for 566 MMPI items and for 3+ 
items from the Wesley Rigidity Scale. In 50 
forced-choice blocks (FC-1) the items consti- 
tuting the original 4 scale were used as anxiety 
statements, and in 50 forced-choice blocks (I°C- 
2) items which exhibited a high correlation 
with total scores on the original Æ scale were 
used as anxiety statements. The Ss were re- 
quired to choose one statement in each triad as 
Most descriptive and one as least descriptive of 
themselves, By use of Key 1, scores were as- 
signed according to the ranking of the anxiety 
Statement as most or least descriptive relative 
to the two nonanxicty statements, while in Key 
2 the ranking of the anxiety statement relative 
only to its matched nonanxiety statement was 
Scored. This forced-choice scale of anxiety was 
administered to 209 Ss who had taken the 4 
scale about ten weeks previously. 


The following results were obtained : 


1. The correlation between FC-1 and the 
A scale was significantly lower that the A- 
Scale test-retest correlation when Key 2 was 
used, but not when Key 1 was used. 

2. Items selected on the basis of their high 
Correlation with the 4 scale in the single-choice 
form were also correlated highly in the forced- 
choice form. The scores obtained on FC-1 and 
FC.2 could therefore be combined into FC-T. 


3. The Æ scale and the Key 1 score of the 
forced-choice scale were more reliable in terms 
of internal consistency than the Key 2 score of 
the forced-choice scale. 

4. The positive skewness of the distribution 
of the 4- scale scores was corrected when the 
forced-choice scale was used. 

5. The negative correlation with the K 
scale of the MMPI was highest for the 4 
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scale and lowest for the Key 2 score of the 
forced-choice scale. Both differed significantly 
from the Key 1 score of the forced-choice scale. 

6. One group of 32 Ss took the 4 scale un- 
der instructions to appear as favorable as pos- 
sible, and another group of 32 Ss, matched with 
the first group on the basis of their .4-scale 
scores, took the forced-choice scale under the 
we biasing instructions. While both the 4 
scale and the Key 1 scores of the forced-choice 
scale were lowered by deliberate faking, this 
reduction was greater for the Æ scale. The Key 
2 scores of the forced-choice scale were not af- 
fected by biasing instructions. 


7. Statements matched on the basis of social 
favorability were not of equal value after they 
were put into forced-choice form. 


Anxious subjects differed from nonanxious 
subjects in their estimate of the social desir- 
ability of anxiety statements. This was taken 
as evidence that the influence of social favora- 
bility may not have been entirely eliminated 
by the use of the forced-choice technique. How- 
ever, the results of this investigation indicated 
that the influence of social desirability on test 
scores could at least be drastically reduced, 
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In an earlier study, Guertin [3, 4] found 
some factor analytic evidence for three types 
of paranoid schizophrenics, but the general do- 
Main of schizophrenia investigated was ae 
broad to bring the smaller area of paranoi 
schizophrenia into clear focus. The three tenta- 
tive factors suggested were the persecuted-sus- 
Picious, the Superior-grandiose, and the over- 
ideational. In a transposed factor analysis of 
a portion of these data [5] a large first factor 
Was obtained which could be identified as para- 
noid schizophrenia but again the sample was 
too broad to provide a focus solely on paranoid 
schizophrenia. 

The present report is on a propagdeutie 
study designed to explore the possibility i. 
further subtyping paranoid schizophrenics y 
Sampling the behavior of only paranoid schizo- 
Phrenics and subjecting the results to a trans- 
Posed factor analysis. 


Method 


The study is based upon 24 hospitalized 
males who were diagnosed as paranoid ay 2 
Phrenics by the hospital staff. In all cases the 
investigator looked for intrinsic or oe 
evidence of paranoid psychosis at the vine : 
testing in order to avoid including any su je S 
who might be in complete remission. E 
twenty-fifth subject is a hypothetical poan 
individual derived from normative data in the 
MMPI manual. 


It is interesting that an earlier study independ- 


This work was conducted at Beatty Memorial 

Ospital, and the report completed at and released 
from Veterans Administration Hospital, Knoxville, 
Iowa, 
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ently employed this “normal” individual in a sim- 
ilar fashion [1]. It Was necessary to exclude over 
one-half of the original paranoid sample selected 
for this study for various reasons. Among the orig- 
inal 51 subjects, only two had to be discarded be- 
cause they were uncooperative and hostile, This 
would suggest that there was an adequate sampling 
of hostile-reacting individuals. Five were excluded 
because they appeared to be in good remission while 
four had to be discarded because of foreign-lan- 
guage background which made communication difh- 
cult. Two more individuals were discarded because 
their distribution of true and false answers left too 
small a proportion in one of the tails. It was felt 
that no serious harm was done to the representa- 
tiveness of the sample because of these exclusions. 
However, it was necessary to exclude 13 individuals 
who were too confused as demonstrated by their 
clinical behavior or their unreliability on the test. 
This suggests that the only really important biasing 
of the final sample was in the direction of the ex- 
clusion of paranoids with appreciable confusion. 

It was necessary to employ some technique of 
evaluating the individuals on a number of test 
items in order to make a transposed analysis, 
choice lay among three areas; 
toms, checklist of behavior, 
and interests. Since the MMPI was desi 
include sampling of significantly deviant Paranoid 
behavior, it was felt that these cards might Provide 
a group of items which would pro 
sampling the avowed 


attitudes 
gned to 


reement on these sel 
: concurred independently on the 
f 100 items employed. An additional fifteen 
items from the L scale of the MMPI were included 


to provide some Statistical contro] over the distortion 
of answers, 


€ctions and 


The subjects were told that this Was a research 
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i istance would be appreci- 
E eno that the information ob- 
ma a not for their hospital folders but would 
ie cet for scientific Purposes. Each un Ra 
asked to sort the 115 cards into the true 1 aa 
boxes according to whether he felt that ice 
ment was true for him Ly a = fo 
i x very w S a 
pees Fes ak eee of items into 
Pe aig ae another, After the 115 items had been 
ON subject was asked to re-sort the 15 
items from the L scale in order to provide a ampl 
reliability check. With these controls it was possible 
to say that the results were reliable and that some 
external criterion was available to indicate the va- 
lidity of the sorting of the 100 test items. T he mean 
number of L items answered in the proper direction 
was 10.48, thereby indicating relatively little dis- 
tortion operating for this Sample. The mean number 
of agreements upon retest with the L items of 13.24 
is also high. 


Tetrachoric intercorrelations among individ- 
uals were obtained from fourfold contingency 
tables and charts. The resulting intercorrela- 
tion table was factored by the multiple-group 
centroid method. Communalities were esti- 
mated by employing the largest correlation 
within a cluster for those individuals within 
a cluster. Those who lay outside of clusters 
had communality estimates based upon the 
highest intercorrelation in the whole column. 


Results 


The intercorrelation matrix, which will not 

be presented here in order to consery 

disclosed a great many medium high as well as 

high correlations with positive signs. Negative 

signs were largely absent. In doing a cluster 

analysis, it became obvious that one very large 
group factor was Predominant. After extract- 
ing two group factors simultaneously, it was 
decided that a complete centroid check should 
be made to see whether the first of these ob- 
lique factors had pulled out sufficient variance. 
A complete centroid through the reduced in- 
tercorrelation matrix extracted a factor which 
accounted for 55% of the estimated com- 
munality. In contrast to this, the first group 
centroid factor had accounted for 45% of the 
estimated communality. It was felt that this 
group factor would be more meaningful and 
accounted for sufficient communality to be re- 
tained. Further cluster analysis was made on 
the residual matrix obtained after the first two 


e space, 
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oblique factors were extracted. After me 
identifiable clusters had been located, the 
factoring was begun. Mutiple-group centro! 
extraction of these four factors simultaneously 
produced the oblique factor matrix reported 2 
Table 1. Inasmuch as no further clusters a 
individuals could be determined and since 85% 


Table 1 


Factor Matrices for Subjects 


Subj. Oblique faciors* ANEEORNT 
no. represent 

A B ë p ı m ww 
i7 S8 36 s8 s2 g8 w 05 o 
25 8S4 40 78 46 I 26 Be eG 
12 3 70 75 37 8&3 39 2i o4 
9 S0 2 49 45 g e o 
21 73 32 56 32 73 02 t a 
6 68 39 27 533 a a eee 
15 53 38 49 45 8 O 
4 5 2 32 44 53 01 00 17 
3 St 32 15 45 51 12 -2 ; 
2 30 80 39 oa 30 74 03 = 
13 26 75 47 -04 26 71 22 -17 
23 36 71 n o 36 62 -30 28 
14 29 58 53 37 29 st 33 
16 23 47 27 2 23 a 06 05 
1 05 34 30 o6 os 35 0 5 
8 64 56 8 4 64 33 A -11 
24 27 18 79 1 27 08 A 08 
5 72 56 72 4g 72 2 «2 1 32 
11 46 62 0 s 46 47 = -19 
22 57 12 65 22 57 -13 = 04 
2 33 ggg 33 «19 3 H 
7? BRBN a G a 
18 26 06 2 67 26-05 y 2 
0 A Bä 59 a7 =i 40 
19 12 28 25 38 12 25 — 


2 
Zaij? — 7.19 2.76 2.02 


* Decimal points omitted. 


tions among the factors. Only menn 
between factors B and D was ilip 
correlations of factors C and D eee of the 
of the order of .6, while [a 
order of .4 were found between i No. 2 
and B, B and C, and C and D. Subjec 
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who was the normative one obtained from the 
MMPI, shows interesting loadings on the 
factors and determines to a large extent the 
identity of Factor 4. 


Disc 
The estimated communality among the para- 
noid schizophrenics in this sample of 63.390 
of the total variability of all the individuals’ 
test behavior gives good support for the com- 
Monnoss of people within this diagnostic cate- 
gory. It is seen from this statistic that they 
“re more similar in behavior on these test 
Items than they are different. The four group 
factors extracted accounted for 859 of this 
communality and 54.466 of the total variance 
of the individuals, This means that by refer- 
ence to these four personality types, more than 
506 of the variability of these individuals can 
be described, i 


ussion 


Socially Normal Paranoid Type (A) 


This is the type of paranoid who makes a good 
social impression in his behavior and makes a diag- 
nosis of paranoid schizophrenia difficult. Usually, 
diagnoses of such a paranoid psychosis depend upon 
obtaining a valid history of delusional action in a 
single rather restricted area. This factor or person- 
ality type might be described as a normalcy factor 
inasmuch as individuals who are of this type cor- 
respond closely to the answers given by the norma- 
tive individuals of the MMPI (subject No. 25). 
This factor seems to be largely a common species 
factor as described by Cattell [2], ie, they are 
similar in that they are human beings. The only 
consistent deviant response they give is wondering 
if they locked the door and closed the windows 
when they are away from home. Among their nor- 
mal responses, there is nothing particularly striking. 
Individuals who approximated this type, almost 
without exception, gave indications of restricted de- 
lusions on just a few of the 100 MMPI items. These 
few markedly abnormal responses appearing for a 
subject did not have sufficient weight to prevent 
him from being predominantly of this type. 

The nine most typical type Æ individuals gave 
the deviant answer: worries about doors and win- 
dows. Nondeviant answers were: not happy alone, 
not an important person, not being talked about, 
never feels like smashing things, not obsessed with 
bad words, home life pleasant, no strange or pecu- 
liar sensations, no one stealing ideas, not afraid of 
knives, not being followed, most people would not 
lie to get ahead, not inspired to life of duty, never 
kept diary, and never feels like going to pieces 

Grandiose and Delusional Paranoid Type (B) 


This type of paranoid is a very outgoing and over- 
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productive person whose delusional are 
largely in the grandiose area. People, to him, are 
objects of his environment without any emotional 
importance; overideational trends are also present 
for this type. These individuals gave a mean num- 


ber of true responses for the 100 items of 65.5 


systems 


which, as compared with the mean of the other 
three groups of only 41 responses, seems to be clear 
evidence of overproductiveness and expansiveness. 
The four most typical type B individuals gave the 
deviant follows: strong political opin- 
ions, agent of God, peculiar odors, being talked 
about, strange and peculiar sensations, unusual re- 
ligious experiences, inspired to life of duty, never 
felt better, most people would lie to get ahead, likes 
to know who to get next to on a job, people make 
friends because they are useful, and wonders why 
people do things for him. Nondeviant answers were: 
daily life full of interesting things, talks to stran- 
gers, li serious lectures, good leader, sex life 
O.K., likes science, and judgment never better, 


answers 


Evasive and Well-Integrated Paranoid Type (C) 

This type of individual seems to be one who re- 
tains a good integration and is able to conceal many 
of his delusions. Just what the type of delusion 
might be probably would vary among individuals 
but they all seem to be rather successful in covering 
up their areas of difficulty. One is impressed by the 
nature of their uniform denials on test items, Re- 
lated to this is the fact that they gave fewer true 
answers than any of the other types. One gets the 
impression that this is the type of individual who is 
rather amoral and not too cooperative or productive 
in mental status inquiries. This type of individual 
would also make diagnosis difficult although the 
history should be more productive than for the type 
A who seems to have more restricted delusions. The 
relationship between this type and type 4 
tremely high, probably because they 
high degree of personality integration, 

The five most typical type C individuals gave the 
deviant answer: would not like expensive clothes 
Nondeviant answers were: doesn’t want to know 
who to get next to on a job, don’t feel like failu 
when hearing of another's success, never made to ac 
things by hypnosis, not bothered by sex thougl : 
safe to trust people, can be friendly With those ae 
do wrong, never disgusted over sex, parents mi a 
him obey, never about to go to Pieces, likes ie, 
seldom constipated, and nobody influencing mind. , 


Sensitive, Inadequate, and Withdrawn Type (D) 
This type of individual seems to experienci x 
treme feelings of inadequacy A 


l and many 
type conflicts. He seems to be an t 
who has tried 


unsuccessfully to p] 
and has now come to evaluate himself as “ba 

boy. Inhibitions and suppression of Seek > s oe 
sion are paramount in this type of individual Gs 
see this in the area of Sexual as well as oth aay 
personal behavior. This individual dees Bet aren os 


is ex- 
both retain a 


neurotic- 
immature person 


ease the parents 
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be very delusional and it is seen that the cag apr 
between the delusional type B and mn De en pas 
low. It is questionable whether ue cs 
Id be classified as paranoid inasmuc i i y 
a to manifest predominantly catatonic symp 
a 
yes three most typical type D agg 
deviant answers: others know thoughts, s gers 
geen ally, dirt disgusts, compulsive counting, 
— ea aE bad words, been in trouble over sex, 
tanec ts sex thoughts, criticism hurts terribly, 
a dane, never talks to strangers, dislikes 
FA lectures, SE roep mikes A 
hey are useful, peop e 
oy Bas gent oe why people og ee 
deviant answers were: conduct controlle y cus 
2 doesn’t want to know who to get next to on a 
a ens mouth shut when in trouble, thoughts 
FEA too fast to speak, could never benefit world, 
have felt better than now, sleeps without disturbing 
thoughts, not afraid of germs, never had unusual 
religious experience, and never kept diary. There 
were too few individuals in the last classification to 
make a good evaluation of the nature of the factor 
type and yet one feels that they do not share the 
common features that the first three factor types do. 


The present study is regarded as being too 
restricted to yield results which can be pro- 
posed as classificatory types or criteria, but 
should serve as an illustration of the useful- 
ness of the transposed factor-analytic technique 
in deriving such systems. It was felt that the 
selected MMPI items proved to be very useful 
samplings of Personality variables even though 
they have a subjective basis, It is the investi- 
gators’ opinion that these items can be em- 
ployed successfully in other factor-analytic 
Studies of pathological groups that might be 
capable of responding reliably and validly, such 
as cases of organic brain disease. It does seem 
clear from these results that at least two sub- 
types of paranoid psychoses should be distin- 
guished: the first, the socially normal well- 
integrated individual, and secondly, the grand- 
iose delusional Person. It is conceivable that 


these two phenotypes might represent different 
phases of the same disease process, 


as been made of Krae- 
leading to many con- 


structive empirical investigations. ‘The — 
have felt that such empirical studies shoul i 
encouraged and that methodological BE 

mentation will prove profitable in eventua 7 
establishing more effective classificatory sys 
tems. 

2. This paper is a research report ona freak: 
posed factor-analytic study of 24 male paras 
noid schizophrenics and one statistically m 
mal.” One hundred selected Minnesota Mu e 
phasic items were employed to provide TRE 
of avowed attitudes and interests. Brief euie 
upon reliability and validity were incorporate ‘ 

3. The factor analysis disclosed a large ae 
monness among the individuals in this ee 
Three Personality types included under tos 
classification of paranoid schizophrenia are sug 


ially 
gested. They are as follows: 4 — ie 
normal paranoid, B — grandiose and de ee 
al paranoid, and C — evasive and we 


tegrated paranoid. A fourth factor type hea 
closed is the Sensitive, inadequate, and E w 
drawn type. This latter may correspon 
the catatonic subtype of schizophrenia. m ai 
In general there was a ganaras o 
the classification of paranoid, but at least aa 
types are different enough to merit ae 
classificatory labels. They were the socia 


. nd- 
normal well-integrated person and the gra 
iose delusional type. 


Received February 9, 1953, 


References Min- 
1. Borko, H. A factor-analytic study of T using 
nesota Multiphasic Personality ge Psy- 
a transpose matrix (Q-technique). 47 
chologist, 1952, 7, 342, (Abstract) rk: Har- 
2. Cattell, R. B, Factor analysis, New YO 
Per, 1952, f schi- 
D 0 
3. Guertin, W, H, A factor analytic era the- 
zophrenic symptoms, Unpublished ; 
sis, Michigan State Coll., 1951. f schi- 
4. 


P dy 0 
Guertin, W, H. A factor analytic ae % 4952 
zophrenic symptoms. J. consult. Psy P 
16, 308-312, alysis ° 
5. Guertin, W. H. An inverted ee oy 2, 16, 
schizophrenics. J. consult. Psychol, 
371-375, 


Journal of Consulting Psychol 
Consultsy ycholog 
Vol. 17, No. 6, 1953 R 


Validity of a Paper-and-Pencil Form of the 
MMPI Psychopathic Deviate Scale 


Solomon Machover 
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and Helen J. Anderson 


Brooklyn College 


It is occasionally of clinical interest to 
know how a patient performs on a single con- 
Stituent scale of the Minnesota Multiphasic 
Personality Inventory. Under such circum- 
Stances the administration and scoring of the 
entire inventory seems an unwarrantedly long 
and cumbersome procedure. Furthermore, the 
Conventional way of recording and scoring re- 
Sponses tends to deflect attention away from 
the content of the individual responses and 
from the Patterns of responses which contribute 
to the total scale scores. Material of manifest 
and potential clinical significance is thus too 
readily overlooked. Both limitations on the 
usefulness of the MMPI would be obviated if 
there were available paper-and-pencil forms of 
the separate constituent scales of the inventory. 
. + Teparation of forms for the separate scales 
Involves the segregation of items pertaining to 
each of the scales. The subject is then required 
to respond to items which are in a sequence of 
related items and divorced from the total con- 
text of randomly distributed unrelated and “si- 
lent” items. What effect does this segregation 
and massing of items into separate constituent 
Scales singly administered have on the validity 
of the resultant scores? The present study was 
designed to answer this question as it applies to 
the Psychopathic Deviate scale which has been 
Teported [1] to have reasonably satisfactory 
validity when administered in the standardized 
card form. 


Method 
A mimeographed form of the Psychopathic 


Deviate scale was prepared with the 50 items 
of the scale arranged in the same order as in 


McKinley and Hathaway's original listing 
[3]. By way of identification, each item was 
lettered and numbered to accord with its desig- 
nation in the manual [2]. To facilitate scor- 
ing, each item was assigned either an even or 
an odd number which was imprinted in front 
of the identifying designation so that a sub- 
ject's score on the scale might be found by 
simply counting the even-numbered items 
marked “true” and the odd-numbered items 
marked “false.” The mean and standard devi- 
ation for normal males were imprinted at the 
bottom of the form for use in conversion of 
raw scores into T scores. Instructions to the 
subject and the first two and last three items of 
the scale follow as samples to illustrate the 
arrangement. 


Below are 50 statements about yourself. Read 
each statement carefully. If what it says is true ys 
you, draw a circle around the T at the end of th 
line. If what it says is false for you, draw a (iets 


around the F. Start at the top of the z 
statements. Work fast. PAE- Matkal 


1A4 I am neither gaining nor losing wei 
sing weight. 
6B42 I have used alcohol excessively, oe ae 
3126 Lam easily downed in an argument TEF 
4127 Ifind it hard to kee i F 
keep my m sk 
hy T y mind on a task bi 
8130 My way of doing things is apt to be 
misunderstood by others. TF 


Mean 14.00 Standard Deviation 4.00 
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a range of 16 to 59. They were classified psy- 
chiatrically as follows: 


t9 
-na 


Chronic alcoholism 
Drug addiction .... 
Mental deficiency 
Schizophrenia ..... 
Psychosis due to alcohol . ; 
Manic-depressive psychosis 
Psychoneurosis ..........-.. se 
Psychopathic personality 


a) 


NOPE 


Half the subjects were individually tested 
first with the paper-and-pencil massed form of 
the Pd scale and then, after one to three days, 
with the entire inventory in standard card 
form. The remaining half received the standard 
inventory first, followed, after a like interval, 
by the experimental form of the Pd scale. It 
was thus possible to check the validity of the 
experimental paper-and-pencil form of the Pd 
scale against the criterion of the Pd scale de- 
rived in standard fashion from 


the administra- 
tion of the MMPI as a whole. 


Results 
As shown in Table 


1, the mean T score of 
the 50 subjects on th 


€ experimental form of the 
Pd scale is 64.24 as against a mean of 63.56 
on the standard form of the scale. The dif- 
ference is well within chance expectancy, p 
being equal to .62 for a two-tailed test. Rota- 
tion of the order of administration to equalize 


Comp. 
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for both forms any effect of practice or famili- 
arity seems to have been superfluous. The dif- 
ference between the means for tests admin- 
istered first and for those administered second 
is exactly zero. Nor does it seem to area 
whether the experimental form or the standar 
form is administered first. 

The Pearson correlation coefficient between 
experimental-form scores and standard-form 
scores was found to be .79. In view of the fact 
that a test-retest reliability coeficient of -71 is 
reported by McKinley and Hathaway [3] A 
the standard form of the Pd scale, it T 
said that the paper-and-pencil form of the Ad 
scale is as valid, against the criterion of ee 
standard Pd scale, as the standard Pd scale à 
itself reliable. Greater validity, of this derive 
type, cannot be expected. 


Discussion 

It appears that no loss of accuracy neue 
from segregating the items of the Pd scale = 
administering them in massed sequence ah 
Separate paper-and-pencil scale out of the a 
text of the MMPI as a whole. Such cushioning 
effect as may normally be exerted by the a 
lent” items of the MMPI and by items a 
relevant to the Pd scale seems to be witho 
consequence for the total score on the she 
seems impressive that the equivalence “yt 
out-of-context Pd scale with the standard 


Table 1 


arison of T Score Means on the Stand 


ard and Experimental Forms 


of the MMPI pg Scale 
Range of ~ $ 
Item N T scores Mean SD Diff. 4 
Standard Pd scale 37—98 63.56 g2 
50 1.33 51 i 
Experimental Pd scale 35—93 64.24 ` 
First-test scores 37—93 64.0 ee 
50 1.33 l 
Second-test scores 35—98 64.0 f 
Experimental scale 42—93 67.24 m 
25 ` 2.18 48 
Standard scale 45—98 66.48 
Standard scale 37—86 60.64 m 
25 f sa 
: 1557 
Experimental scale 35—88 


61.24 
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of the scale has been established with a quite 
deviate population. While direct evidence is 
lacking, this finding at least suggests the pos- 
sibility that others of the constituent scales of 
the MMPI may also fare well as separate 
scales, 

A number of advantages accrue to the avail- 
ability of the constituent scales which may be 
administered in separate  paper-and-pencil 
form. The clinician’s attention is perforce di- 
rected to where it should be, viz., the subject’s 
actual responses. Identical total scores on a 
Elven scale may stand for quite different pat- 
terns of actual behavior. Variations in item 
Clusters, although irrelevant to total score, may 
be quite Significant for personality evaluation 
and behavior prediction. Ready availability of 
the concrete responses provides provocative ma- 
terial which is useful in structuring follow-up 
clinical interviews. Finally, availability of the 
Separate scales is a contribution to efficiency in 
those instances in which information on less 
than the total inventory is sought. 


Summary 


1A Paper-and-pencil form of the MMPI 
Pd Scale, prepared as a separate scale, was ad- 
ministered individually to a group of 50 psy- 
chiatric patients. Scores on this experimental 
form of the Pd scale were compared with 
Scores obtained by the same subjects on the Pd 
Scale when administered in standard form as 
Part of the total MMPI. 


2. A correlation of .79 was obtained be- 
tween scores on the experimental form and 
scores on the standard form of the Pd scale. 
The out-of-context paper-and-pencil Pd scale 
may be said to be as valid, against the criterion 
of the standard form of the scale, as the 
standard form of the scale is itself reliable. 

3. The mean score for the experimental 
form was found to be not significantly different 
from the mean score for the standard form. 
Order of administration of the two forms 
made no difference. 


+. Availability of a separate Paper-and-pen- 
cil form permits more efficient and flexible use 
of the MMPI, directs attention to clinically 
significant content, presénts data useful in fol- 
low-up interview, and provides a permanent 
record of detailed concrete responses in readily 
utilized form. : 
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Ellis on Personality Inventories 


Allen Calvin’ and James McConnell 


The University of Texas 


In a recent article in this journal, Albert El- 
lis seriously questions the value of the person- 
ality inventory [2]. He raises a series of objec- 
tions to the use of these inventories which do 
not seem fully justified to us. Although Ellis 
questions the value of all such inventories, he 
mentions only the MiMPI by name. Since we 
cannot be certain which techniques other than 
the MMPI Ellis has reference to in his study, 
and since it is known that the various inven- 
tories show serious differences among them- 
selves in construction, reliability, and validity, 
we will confine our rebuttal to a defense of the 


MMPI. 


It is perhaps best that Ellis’ sweeping con- 
demnation of the Personality inventories be 
answered point by point. His objections are 
centered around five arguments, the first of 
which is that “in most instances 


the inventories 
are not measuring the inde 


, it was impossible 
studies applied spe- 


A check of the literatu 
only two studies in which 
MMPI subscales wer 


re, however, shows 
intercorrelations of 


the MMPI Manual [3] sho 
for freedom from 
been made by the 


ws that no claim 
intercorrelation has ever 


authors of the test. They 
1Now at Michigan State College, 


e 
point out that the correlation of the er 
with the P¢ scale for normal cases is - a 
that it drops to .75 on abnormal cases. mr 
state specifically that “The scale eons is 
tions, which vary widely, will be = 
interpret until more data are available Scent 
dynamic inter-relationships of the di 
clinical syndromes” [Secp: S] — 

It seems necessary here to make the E EKo 
tary statistical observation that althoug 


in- 


n 
hly 


an em- 
pon 


een es 


the 


. £ 
lis 15 ae 
artiat” 

orough 
ly compensate for this, we felt tat a thor to 
examination of the studies whic Tia iblio- 
faking would be of value. Y oa [4] f ja 
graphy listed in the MMPI Atla ne. relevan 
guide, we were able to find ni 
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Studies, eight of which showed that faking 
Could be detected at a statistically significant 
level. 

Ellis’ next objection is perhaps the most 
Serious. He states that personality inventories 
_ Usually do not give significant group discrim- 
Inations when used with vocational, academic, 
Socioeconomic, and disabled and ill groups. It 
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was especially found that, in none of the areas 
in which they are commonly employed, do per- 
sonality inventories consistently show signifi- 
cant group discriminations’ [2, p. 48]. He 
supports this statement by an analysis of 499 
studies of personality inventories. Since he 
again fails to give references to the particular 
studies he used, we decided to examine all 


Table 1 
Significant Discriminations Found in Research Studies 
with the MMPI, 1940 through 1950 


Number of studies Number of studies Total 
ea a š in which signifi- in which no signifi- number 
Criminations tested cant discrimina- cant discrimina- of 
tions were found tions were found studies 
Inventory scores ys. diagnostic 
examinations: 
Neuropsychiatric conditions 14 s 18 
Psychosomatic conditions 1 0 7 
Delinquent, criminal, and 
Psychopathic behavior 5 t 6 
Alcoholism # : 4 
Predicting success in treatment 9 0 9 
Total 33 > as 
Inventory scores ys. behavioral 
characteristics: 
Extent of social participation 4 Q 4 
Tendency to become a sexual 
deviant y 1 
Success at motor tasks 1 9 1 
Miscellaneous behavioral 
characteristics 5 0 
Total a g 11 
Inventory scores vs. vocational 
and academic test and 
Performance results: 
Tendency to have specific 
vocational interests 3 0 3 
Membership in different voca- 
tional groups 2 2 4 
Success in actual vocational 
performance Fi 2 6 
Success in academic achievement 3 0 3 
Total 12 4 15 
Inventory scores ys. group 
differences: 
Intellectual groups 3 0 
Sex groups 2 0 3 
Socioeconomic groups 3 2 
Disabled and ill groups 2 k 3 
Miscellaneous groups $ à o 2 
Total 15 9 5 
Crand Total 71 s ; 15 
ae P 
Waak re Coala Hed T kee eel Mimers (21. We hav = 
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the published studies available to us wua 
were relevant tọ the categories he lists a i 
table to see how the MMPI would 2 ap 
under this type of examination. Since t i t- 
las includes most papers which miake more t = 
a passing reference to the MMPI from La 
to the end of 1950, and since the studies Ellis 
lists are from the period 1946 to 1951, we felt 
that most of the pertinent studies would be in 
this list. 


The data presented in Table 1 seem to show 
that Ellis is in serious error in his belief that 
the MMPI does not consistently show signifi- 
cant group discriminations and that, as Ellis 
puts it, different experimenters keep obtaining 
directly contradictory results when using the 
same or similar inventories. 


Ellis’ final criticism is, we think, the most 


personality in- 
ventories are most effectively used, they tend to 


consuming as alter- 


necessary to add that 
clinical criteria, 

This belief that the clinical psychologist can 
gain more pertinent, incisive, and “depth- 
centered personality” material from more in- 
tuitive techniques than from the MMPI calls 
for careful examination. Again space does not 
permit a lengthy discussion of the validity of 
these intuitive techniques. We would, however, 
like to mention briefly a recent study by Holtz- 
man and Sells [5]. 

These authors have presented us with an 
excellent study of the efficacy of present-day 
clinical techniques. They administered a bat- 


ation cadets. The 
d to some of the 
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eliminated from the program because they de- 
veloped overt personality disturbances. The 
clinicians were asked to separate one group 
from the other on the basis of the protocols. 

The results of this experiment were that 
no clinician or combination of clinicians using 
any single test or any combination of tests 
could predict above the chance level.? But n 
most disturbing finding of this study was the 
interclinician variability. To read that one 
group of clinicians in general described a cadet 
as having strong ego strength or a good ien 
sexual adjustment pattern, and then to m 
that other clinicians felt in general that the 
same cadet evidenced latent schizophrenic 
trends or latent homosexual tendencies saree 
us to lose a good deal of our faith in ge 
intuition and in the tests employed in thi 
study. R: 

The results of the Holtzman-Sells has 
ment, when compared to the findings listed M 
Table 1, lead us to believe that Ellis might pe 
prove his clinical intuition by laying aside s 
projective techniques for a furtive glance at @ 
MMPI profile. 
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Buros, Oscar Krisen. (Ed.) 
measurements yearbook. 
(220 Montgomery St.): 
Pp. xxiv + 1163. $13.00. 


This volume covers the period 1948 a es 
and attempts to list all commercially se ae aei 
educational, psychological, and vocations OP 
lished as Separates in English-speaking Sean . 
during this time, The list includes the Woot 
total of 793 tests, 130 more than the Third — 

any more personality tests have been A RS 
together with a number of tests which are ri TI ere 
only as a Part of restricted testing Paaa A 
are 596 original test reviews by 308 ad Mate ref- 
Excerpts from journal test reviews, and + A ifii 
erences on the construction, validity, use, eT 
itations of specific tests. In addition, 429 bgt . 
Measurements and closely related fields be ee 
and extensive excerpts from reviews of = : oe 
are reprinted., This volume, as have been T o 
ceding ones, is magnificently organized, indexed, a i 
Cross-indexed. The complete hibliagipKiesitar Sa A 
test are invaluable. Some criticisms of PORER TO . 
umes haye been well heeded, as the listed naie 
tions to the test reviewers, and their fps 
indicate. The level of the test reviews is a E 
high, and for the most part judicious. A 3 
views are Possibly excessively bitter. Most ok 
Controversial tests have two or more Kay cece the 
a comparison of the reviews serves to E 
Problem of possible personal ‘bias: of the IEG by 
study of the reviews of several different es here 
one reviewer may also be very aminuts tidk- 

DY prospective test user can certainly vE om 
ly, authoritatively, and painlessly what tests ino: 
are for any purpose, and what he needs to ae 
about any test, so far as the knowledge is a ed 
able anywhere, Would-be test constructors ake ata 
to read and reconsider—maybe their brain chi 
Should be aborted. But if it must be be oe A 
term, what should and should not be done is amply 
exemplified here. Read and heed! —4. R: 


The fourth mental 
Highland Fark, N. J 
Gryphon Press, 1953. 


Note.—The reviews were Prepared by the Associ- 


ate Editors, who may be identified by their initials, 
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evereux, George. (Ed.) Psychoanalysis and the 
eh New York: International U Niversities 
Press, 1953. Pp. xv + 432. $3.00. 


This is an anthology of widely differing hg 
on “telepathic” and “clairvoyant phenomenn by 
psychoanalysts and psychoanalytically oriented writ- 
ers. For the most part, the e ays are based on 
the authors’ observations of correspondences between 
thoughts of patients and analyst, 
tient’s (or analyst's) thought and external events, 
The from heated disbelief with 
explanations in terms of chance, Suggestion, projec- 
tion, faint sensory clues, ete., to fiery belief in l 
reality of thought transmission with arguments for 
nerve induction, identification, ete. Protagonist and 
antagonist each ascribe “deep unconscious sources 
to the other's opposition. Calls for experimental 
validation by skeptics are often ignored by beliey- 
ers, or sometimes scoffed at, as when 
out: “Since when has the unconscious ANY respect 
for scientific evidence?” (p. 331). Meanwhile, edi- 
tor Devereux looks out over this bloody battlefield 
with cool and often brilliant detachment. His rel- 
ative impartiality is evident in the inclusion 
and bibliography, of writers who stre 


or between pa- 


positions range 


the 


Fodor cries 


in text 
ss the two ex 


tremes as well as several middle Positions, But, 
additionally, he writes two chapters of his own that 
are characterized | neither 


haughty 
nor uncontrolled acceptance. Thus, Dey 
some of the self-discipline and rel 
that Freud demanded of himself 
that neither Freud nor many follo 
amply demonstrates, 


skepticism 
ereux displays 
ative lack of bias 
and followers, but 
wers, as th book 
could quite muster.—E, L, K, 
Fliess, Robert. The re 
New York: Intern 
Pp. 164. $3.00. 


vival of interest 


in the dream, 
ational Uniy 


ersities Press, KISS, 


Many years ago Freud co 


mplained that 
lacked interest in 


analysts 
the dream and h 


ad little to add 
ume a close stu- 


recent selected 
rding to clinical 
interpretation, or ad- 
includes as well his 
to the meaning of the 
in the dream. In each instance, F] 
pends his own critical note to the publi, 


frequently Pointing out that the point: 


“spoken 
iess ap- 
hed papers, 
S raised by 
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the contemporary writer were handled or at least 
iess seems 

i i Freud. Indeed, Fliess s 

cognized earlier by Sa 
d constrained to demonstrate that little has 
been contributed to dream theory since Freud’s writ- 
ings on the topic. If he does not entirely succeed 
i t i et 
in this at least he shows conclusively that among 
al A interest in the dream has been “revived, 
This is a useful source book of recent dream studies 
and a provocative pro-Freudian critique of dream 

theory.—A. M. G. 


Hammond, Kenneth R., & Allen, Jeremiah M., Jr 
Writing clinical reports. New York: Prentice- 
Hall, 1953. Pp. xii + 235. $5.35. 


Practicing clinicians, as well as clinical teachers 
and students, often find report-writing difficult and 
reports dissatisfying and ambiguous. This man- 
ual, written jointly by a psychologist and a mem- 
ber of an English department, provides some real 
assistance. The philosophy of report-writing, the 
problems of communication with sophisticated and 
unsophisticated readers, and the effective use of 
technical and nontechnical vocabulary are particu- 
larly well handled. The sections on style and or- 
ganization seem less directly helpful, although ex- 
amples are consistently drawn from the psycho- 
logical field. Many of the points made, and all 
of the extensive illustrative case material, are the 
outgrowth of suggestions provided by staffs of many 
different institutions polled by the authors. This 
book will find its way into the psychological 1j- 
brary of most clinics and hospitals; it deserves con- 
sideration also by university teachers of clinical psy- 


Kogan, Leonard S., Hunt, J. McVicker, & Bart 
Phyllis F. 4 follow-up study of the results of 
social casework. New York (192 Lexington Ave.) : 


Family Service Association of America, 1953, Pp. 
115. $2.50. 


elme, 


This is the detailed report of an intensiye follow- 


up study of the adjustment of 38 families five years 


All accessible mem- 
ed and interviewed 
with the nature of 
Practically all for- 


Ppears to have been 
ases but was not re- 
ement after closing, Psy- 
find especially valuable the sec- 
methodological and design prob- 
studies—E, L. K, 
Lacey, Oliver L, 
tation, New Y 
249. $4.50, 


This is a brief introductory text designed to in- 
trode students to the use of Statistics in experi- 


Statistical methods in experimen- 
ork: Macmillan, 1953, Pp. xi + 
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mentation. It is clearly written and well oa 
oped. Its use, however, will come at an par 
tary, introductory level. It is not designed for 
sophisticated experimenter. — jV. A. H, 


Lindgren, Henry C. Psychology of personal oe 
cial adjustment. New York: American Book Cos 
1953. Pp. ix + 481, $4.50. 


A book about normal people and their sodial m 
lationships, which gives an excellent SaN 
all phases of human adjustment and mental ies is 
While based on psychological findings, the ee 3 
so well written that previous training in psycho qey 
is not needed to hold the student's ugdertanaiig 
and interest. Each chapter is followed by a ath 
cise summary of the important points, together W £ 
a list of source materials and suggested gy eo 
Salient points are strengthened by excellent i si 
trations and cartoons. There is a complete ië 
thor and subject index. Although it is plan id 
as a textbook for college students, the book shou io 
prove interesting reading for anyone vinie 
gain a better understanding of everyday prob 
in human living.—B. M. L. 


; w Ed.) 
Moreno, J. L. Who shall survive? get 
Beacon, N. Y.: Beacon House, 1953. Pp. cx 
763. $10.00. 


. er 

In his 114-page “preludes of the geiomeide Mir 
ment,” Moreno presents a professional ae ine 
phy and concludes it with this apparently ving re 
sight: “There is no controversy about my rover” 
they are universally accepted. I am the oe large 
sy.” There is no statement as to how pare ne 
volume differs from the 1934 edition, to W 4 Ixvi): 
refers here as a “bible of human relations’ (pe ex- 
Comparison of the two indicates that this is ie dis- 
Pansion of the basic outline with slightly a 
cussion of sociodrama, group psychothera ni ight 
Psychodrama, although much less than on raphies 
expect from the subtitle and extensive oe ae this 
devoted to them. More attention is Bee plica 
book than in its Predecessor to the pases Sanad 
tions of Sociometry and sociometric and SF reoreticã 
theory. The original book presented the etric tech 
bases for sociometry and the use of E fact that 
niques with various groups. Despite K 300 titles 
the bibliography is greatly expanded ee is P, 
as compared to 41 in the first edition) wealth i 
attempt to integrate systematically ioe is an a 
Material into the text proper. The pan i jimited 
abashed exposition of Moreno’s adeas jean A 
largely to a consideration of their 9 an widely 
tainly Dr, Moreno has made a gyen nd effectivi 
recognized contribution to the study ete fecls 
use of the group. However, the ~~ presente 
these important ideas could have q would b3 
with greater effect in fewer pages i 
been enriched by integrating them appeare 
standing work of others which aie 
the date of the first edition —F. 
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Naumberg, Margaret. Psychoneurotic art: its func- 
von in psychotherapy. New York: Grune & 
Stratton, 1953. Pp. x -+ 148. $6.75. 


Through the medium of an intensive case study, 
iss Naumberg describes a psychoanalytieslly ori- 
ented method of therapy which relies heavily upon 
the symbolic character of the patient's spontaneous 
art products, ptive and 
reflects the ; 


The presentation is perce 
broad experience of a skilled clinician. 
ler own discussion is bustressed by an analysis by 
Adolph Woltmann of the Rorschach responses of a 
single case in relation to the art work produced 
unig three years of therapy, and by Piotrow- 
ski's comments on the Rorschach generally as it re- 
lates to the therapeutic use of graphic art. A crit- 
ical review of the literature on art in clinical prac- 
tice forms a useful appendix. It is obviously vital 
to the clinical culture for new techniques and meth- 
ods to circulate freely. This book admirably ilius- 
trates the kind of procedural description that will 
allow other Practitioners to adapt Miss Naumberg's 
aPproach to their own therapeutic armamentaria. 
When it is concerned with theory, however, it is at 
times fuzzy, at times doctrinaire, failing to provide 
any adequate underpinning of ideas for the practi- 
cal techniques it advances. More concretely, read- 
Prai may worry about the soundness of the interpre- 
tations derived from art products, just as they may 
Wonder at the applicability of the method to more 
than a fraction of the neurotic population, Miss 
Naumberg's book represents a genuinely creative 
effort. It deserves wide reading and the serious, 
Critical Consideration by which private hunches may 
ba transformed into useful public knowledge.— 


Peters, R. g, (Ed.) Brett's history of psychology. 
New York: Macmillan, 1953. Pp. 742. $7.50. 


In condensing G. S. Brett’s three volumes into 
One: (Yol 1, 1912; Vols. II and III, 1921), Peters 
aS retained the original organization and even the 
writing of Brett. Except for the last of 15 chapters, 
editing was done by omitting entire sections and 


mading introductory statements to each chapter. 
ven in its condensed form, this is a formidable 
volume. 


Except for the new chapter, it is more of 
of thought than of psychology. It traces 
in great detail the developments in philosophy, med- 
‘cine, and the physical sciences that led to psycho- 
logical formulations from earliest recorded history 
to the work of William James. In bringing the 
work up to date, Peters has discarded the original 
chapter on “modern” psychology, and substituted one 
on twentieth-century trends. This summary of the 
history of Psychology for the past fifty years con- 
stitutes a thumbnail sketch of some of the more com- 
Mon schools of contemporary psychology. This 
chapter does not have the sweep of Brett’s treat- 
ment of earlier history, but the editor was frank to 


a history 


467 


recommend other works for fuller treatment of the 
psychology of the past half century. The abridge- 
ment of Brett's History renders en important serv- 
ice to psychology by making it more easily availa- 
ble to students who, in their involvement with the 
technical aspects of modern psychology, may not be 
aware of the origins of current movements.—M/. K. 


Piaget, Jean. The origins of intelligence in child- 
ren. New York: International Universities Press, 
1953. Pp. xi + 419. $6.00. 


This book, taken together with La Construction 
du Reel Chez l'Enfant, and La Formation du Sym- 
bole Chez l'Enfant, constitutes a series of works de- 
voted to the beginnings of intelligence. Piaget con- 
siders with particular care the infantile behavior 
which precedes, but forms the basis for, “intelligent” 
behavior: those clementary*sensorimotor adaptations 
commonly classified as reile and elementary hab- 
its. He is then able, by means of the concepis of 
circular reaction and the formation of secondary 
schemata, to account for the development from sim- 
ple sensorimotor adjustment to the discovery and in- 
vention of new means of adaptation. His empha- 
sis on the importance of perceptual behavior in this 
sequence, and on the significance of learning 
“use”) in promoting intellectual development, will 
strike a familiar note for American psychologists. 
As usual, Piaget shows in this work the careful, in- 
genious observation of infants, and the detailed re- 
ports of even their most fleeting reactions, which 
make his developmental studies so stimulating. It 
should be noted that the translation is excellent, 
rendering an already compelling text into clear, 
pealing, familiar terms. —4. M. G. 


(or 


ap- 


Senn, Milton J. E. (Ed.) Problems o 
childhood. Transactions of the Six 
New York: Josiah Macy, Jr. 
Pp. 160. $2.50, 


f infancy and 
th Conference, 
Foundation, 1953, 


This published account of the Sj 
ence on Infancy and Childhood br 
extended discussions of problems 
with records of the group interchange foll 
each presentation. Escalona reports 
tions of emotional development and 
relationship in the first year of life. 
presents some of the cases of mothers 
studied in connection with the Y 
project. Stewart describes th 
crying in infants which are u 


ixth Macy Confer- 
ings together three 


of infancy, along 


owing 
her observa. 


and infants 
ale rooming-in 


e studies of excessive 


nder way at the Uni- 
All 


ir Contributions both 


it. Papers and 
informal, 
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Slavson, S. R. Child psychotherapy. New York: 
Columbia Univer. Press, 1952. Pp. xiii + 332. 
$4.50. 


This book is much more than its title suggests. 
The consideration of therapy with children is pre- 
ceded by two important sections on normal child 7 
velopment in terms of needs, and on psychopatho - 
ogy in childhood, in terms of early primary Sa 
tionships and fixations. The dynamics of therapy 
are then presented as an outgrowth of these views 
of normal and pathological deyelopment. The au- 
thor acknowledges his indebtedness to Freud and 
maintains throughout a predominantly psychoana- 
lytic orientation. As in his other books, so here 
Slavson probably makes his most significant contri- 
bution in his careful breakdown of the therapeutic 
process, his attention to the role of parents and 
close relatives in affecting child behavior, and his 
emphasis on group factors in illness and treatment. 
The brief case illustrations which occur in the 
text often seem oversimplified by contrast 
theoretical exposition. The somewhat longer ther- 
apeutic record which concludes the book, on the 
other hand, adds considerably to the reader’s un- 
derstanding of the Principles involved. —4. M. G. 


to the 


Townsend, John C. Introduction to experimental 


method. New York: McGraw-Hill, 1953. Pp. 
ix + 220. $4.00. 


This book is intended to appeal to three categor- 

ies of readers: “First, the undergraduate student 

who is undergoing his first exposure to the rigors 

of the experimental method in psychology and the 

social sciences. Second, the student who, with an 

inadequate background in the application of the 

experimental method, finds himself faced with the 

necessity of ‘doing a piece of research’ to satisfy 

thesis requirements, Third, the social science work- 
er who discovers that his job in industry, the clinic, 
the prison, etc., is one demanding the execution of 
research projects.” The writer's Presentation is de- 
liberately superficial; therefore the book's content 
may not be sufficient to the interests or the re- 
quirements of his second and third groups of read- 
ers. The material could prove useful, however, in 
undergraduate instruction, either as supplementary 
reading for the elementary psychology course or as 
Part of the assigned material for the undergradu- 
ate laboratory. The content of the book is con- 
cerned with experimentation as traditionally em- 
ployed in psychology. Chapters 2 and 9, which 
have to do with causal sequences and methods of 
inference, are likely to contribute to clear thinking 
among undergraduates without the care and tedium 
which comparable material in a book on the logic 
of scientific method would require. Two other 
chapters, 7 and 8, which have to do with the con- 
trol of the experiment and Procedure for experimen- 
tation, will be useful to the casual undergraduate 
student of Psychology. Other chapters have to do 
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with such matters as variables, controls, and appa- 
ratus. The meaning of theory and the problem of 
theory building, which are important in experiment- 
al psychology, are for the most part either ignored 
or evaded by reference to other works. This kind 
of book could appeal to a wider audience if it igant 
possible to prepare it in a manner more scholarly, 
thorough, and explicit. Apparently, however, the 
author considers his present superficial treatment 
best for his purposes.—J. R. W. 
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